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TITLE OF THE INVENTION 
PROGRAM, SYSTEM AND METHOD FOR ANALYZING RETRIEVAL 
KEYWORD 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Applications No. 2002-243466, filed August 23, 2002; 
No. 2002-382396, filed December 27, 2002; and 
No. 2003-070281, filed March 14, 2003, the entire 
contents of all of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a program, system 
and method for analyzing the features of retrieval 
keywords input into a WWW (World Wide Web) retrieval 
system (or WWW search system and hereinafter referred 
to as * retrieval system" ) by a Web browsing person 
(hereinafter referred to as just ^browsing person" ) in 
order to search for a target Web page or Web site in 
the WWW. 

2. Description of the Related Art 

As an example of an access target in the Internet, 
a Web page and a Web site are available. The Web page 
and Web site are operated for various kinds of purposes 
including advertisement, information provision and 
order reception. To achieve such an object 
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effectively, the Web page and Web site are analyzed and 
investigated. 

For example, an analyzer can determine a strategy 
about banner advertisement, publication in a directory 
5 site and participation in a prize site by knowing 

through which other Web sites an analyzed object Web 
site has been accessed. The analyzer can determine 
a policy for improvement of the content by knowing 
which retrieval has been executed and whether or not 

10 the analyzed object Web site has been accessed through 

a retrieval engine. 

As a method of analyzing and investigating the Web 
page and Web site, Web access log analysis using Web 
access log, which stores when, how and which Web page 

15 has been accessed is available. There are mainly two 

kinds of the Web access logs. The first Web access log 
is a Web access log (Web access log in a narrow sense) 
recorded in a single or multiple Web servers. The 
second Web access log is a Web access log which stores 

20 accesses on various kinds of Web pages or Web sites by 

a single or multiple browsing persons. The second Web 
access log includes, for example, an access log which 
stores accesses on the Web page or Web site by each 
panel, which is collected from panels (or monitors) by 

25 a WWW audience measurement research company. The Web 

access log mentioned hereinafter means the first Web 
access log. 



For example, the Web access log analysis 
investigates how the number of browsing persons (users, 
visitors) who access the Web page or Web site changes 
depending on time or day of the week. In the Web 
access log analysis, the kind of browser or computer OS 
may be investigated. In the Web access log analysis, 
how a browsing person acts within a single Web site or 
among multiple Web sites may be investigated. For 
example, a path analysis, clarifying that a browsing 
person has browsed Web page A and next browsed Web page 
B, and so on, is included in the Web access log 
analysis . 

On the other hand, to support browsing on the Web 
page or Web site on the Internet, there exists a 
retrieval system indicating as a retrieval result page 
a list on information (for example, uniform resource 
locators (URL), summary information, link . information 
and the list of keyword related pages or keyword 
related site) of Web pages (hereinafter referred to as 
* keyword related page' 7 ) or Web sites (hereinafter 
referred to as * keyword related site" ) . Such a 
retrieval system is widely used. 

FIG. 1 shows an example of screen transition of 
typical Web pages using the retrieval system. If a 
retrieval keyword is input through a browsing person' s 
browser on a retrieval keyword input screen 1, 
retrieval start is instructed and then, the retrieval 



system extracts links 2a to 2c to a keyword related 
page. Next, a retrieval result page 2, indicating the 
links 2a to 2c to the extracted keyword related pages, 
is displayed to the browsing person. If any link on 
the retrieval result page 2 is clicked, the keyword 
related page of the clicked link is displayed on 
a browsing person's browser. For example, a link 2a 
is clicked, a keyword related page 3 is displayed. 
If the retrieval system is employed, the keyword and 
additional information including its input date and 
time are recorded in the Web access log of the Web 
server . 

Therefore, the analysis on the retrieval keyword 
(hereinafter referred to as * retrieval keyword 
analysis'') using the Web access log is enabled. In the 
retrieval keyword analysis, for example, how many times 
some retrieval keywords have been input is investi- 
gated. For example, whether or not the retrieval 
results on the retrieval result page have been actually 
clicked is investigated. For example, how many keyword 
related pages have been extracted corresponding to 
a certain retrieval keyword is investigated. Japanese 
Patent Application KOKAI Publication No. 2002-123517 
discloses retrieval keyword analysis technology, 
commercial tool, non-commercial tool and services. 

In the Web access log analysis, analysis of Web 
sites accessed just before an analyzed object Web site 



and analysis on the number of browsing persons 
corresponding to each retrieval keyword are carried out 
using reference information (known as "referrer") and 
the like. 

However, the conventional Web site access log 
analysis disables an analyzer to understand whether or 
not a browsing person is satisfied with an analysis 
object Web site or how much a success (object) in the 
analysis object Web site is achieved. For example, 
assume that an analysis object Web site intends to 
improve sale amount of products. The conventional Web 
access log analysis enables to obtain the number of 
browsing persons for each retrieval keyword input to 
a retrieval engine if an analysis object Web site is 
accessed based on the retrieval result of the retrieval 
engine. However, even if there are many browsing 
persons, no product may be purchased from an analysis 
object Web site. Even if there are few browsing 
persons, most of them may purchase the product. 

Thus, the analyzer cannot judge whether or not 
a browsing person who inputs that retrieval keyword is 
satisfied with an analysis object Web site and which 
retrieval keyword that browsing person inputs to 
achieve the object of the Web site. For example, 
the conventional Web access log analysis enables to 
investigate how many keyword related pages have been 
extracted corresponding to a certain retrieval keyword. 



The analyzer may judge, from viewpoints of preventing 
some Web pages desired by the browsing person from 
being neglected from extraction, that the more keyword 
related pages are extracted, the more the browsing 
person is satisfied with the retrieval result, and 
conversely the fewer, the less he is satisfied. 
However, the number of the extracted keyword related 
pages does not indicate the degree of satisfaction of 
the browsing person directly. Actually, in some cases, 
if the number of the extracted keyword related pages is 
smaller, the browsing person selects a desired link 
more easily so that browsing person's desire is 
satisfied and the degree of satisfaction is higher. 
That is, if keyword related pages which meet a browsing 
person' s desire are represented to the browsing person 
as a retrieval result, the browsing person is more 
satisfied with the retrieval result in the case where 
a smaller number of extracted keyword related pages is 
presented than in the case where a redundant retrieval 
result is presented. 

Thus, the analyzer cannot judge whether or not the 
browsing person is satisfied with a retrieval result 
from the conventional Web access log analysis. For 
example, by investigating whether or not a link to the 
keyword related pages on the retrieval result page is 
actually clicked and if any link is clicked, which link 
to keyword related page is clicked, it is possible 



to know which keyword related page on the retrieval 
result page has been selected by the browsing person. 
However, it is extremely difficult for the analyzer to 
judge whether or not an accessed keyword related page 
actually contains the contents which the browsing 
person wants and whether or not the browsing person is 
satisfied with the result according to the conventional 
Web access log analysis (evaluate the retrieval result 
qualitatively) . 

BRIEF SUMMARY OF THE INVENTION 

The present invention is directed to method and 
apparatus that substantially obviates one or more of 
the problems due to limitations and disadvantages of 
the related art. 

According to one aspect of the present invention, 
an article of manufacture comprising a computer usable 
medium having computer readable program code means 
embodied therein, the computer readable program code 
means comprising: 

computer readable program code means for causing 
a computer to extract an access sequence indicating 
a continuous access by a same requester based on a Web 
access log which relates first identification data 
indicating an access requester to second identification 
data indicating contents to be accessed; 

computer readable program code means for causing 
a computer to extract, when the Web access log relates 
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second identification data indicating a retrieval 
system to a retrieval keyword which is input to the 
retrieval system by the requester, the retrieval 
keyword from the Web access log; and 
5 computer readable program code means for causing a 

computer to calculate a qualitative evaluation value of 
the access sequence based on a qualitative evaluation 
rule for defining the qualitative evaluation value of 
a retrieval result of the retrieval system, and create 

10 first relation data indicating a relation between the 

qualitative evaluation value and a retrieval keyword 
which is input in the access sequence. 

According to another aspect of the invention, 
an article of manufacture comprising a computer usable 

15 medium having computer readable program code means 

embodied therein, the computer readable program code 
means comprising: 

computer readable program code means for causing 
a computer to extract an access sequence indicating 

20 a continuous access by a same requester based on a Web 

access log which relates first identification data 
indicating an access requester to second identification 
data indicating contents to be accessed; 

computer readable program code means for causing 

25 a computer to extract, when the Web access log relates 

second identification data indicating a retrieval 
system to a retrieval keyword which is input to the 
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retrieval system by the requester and the retrieval 
keyword is input in the access sequence, the retrieval 
keyword which is input in the access sequence from the 
Web access log; and 
5 computer readable program code means for causing a 

computer to calculate a qualitative evaluation value of 
the access sequence based on a qualitative evaluation 
rule for defining the qualitative evaluation value of 
a retrieval result of the retrieval system, and create 

10 first relation data indicating a relation between the 

extracted retrieval keyword and the qualitative 
evaluation value. 

According to still another aspect of the 
invention, an article of manufacture comprising 

15 a computer usable medium having computer readable 

program code means embodied therein, the computer 
readable program code means comprising;.. 

computer readable program code means for causing 
a computer to extract, based on a Web access log which 

20 relates first identification data indicating an access 

requester, second identification data indicating 
contents to be accessed, and reference information, 
an access sequence indicating a continuous access 
including an access to the contents to be accessed 

25 indicated by the second identification data by a same 

requester when the reference information indicates 
a retrieval system; 



computer readable program code means for causing a 
computer to extract a retrieval keyword included in the 
reference information when the reference information 
indicates the retrieval system; and 

computer readable program code means for causing 
a computer to calculate a qualitative evaluation value 
of the access sequence after inputting the extracted 
retrieval keyword based on a qualitative evaluation 
rule for defining the qualitative evaluation value of 
a retrieval result of the retrieval system, and create 
first relation data indicating a relation between the 
qualitative evaluation value and the retrieval keyword 
corresponding to the access sequence* 

According to still another aspect of the 
invention, an article of manufacture comprising a 
computer usable medium having computer readable program 
code. means embodied therein, the computer readable 
program code means comprising: 

computer readable program code means for causing 
a computer to extract, based on a Web access log which 
relates first identification data indicating an access 
requester to second identification data indicating 
contents to be accessed, a sub-access sequence 
indicating a continuous access by a same requester; 

computer readable program code means for causing 
a computer to extract the retrieval keyword when the 
Web access log relates second identification data 
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indicating a retrieval system to a retrieval keyword 
input to the retrieval system by the requester; and 

computer readable program code means for causing 
a computer to calculate a qualitative evaluation value 
5 of the sub-access sequence based on a qualitative 

evaluation rule for defining the qualitative evaluation 
value of a retrieval result of the retrieval system, 
and create relation data indicating a relation between 
the extracted retrieval keyword and the qualitative 
10 evaluation value. 

According to still another aspect of the 
invention, a retrieval keyword analyzing system 
comprising: 

means for extracting an access sequence indicating 
15 a continuous access by a same requester based on a Web 

access log which relates first identification data 
. indicating an access requester to second identification 
data indicating contents to be accessed; 

means for extracting, when the Web access log 
20 relates second identification data indicating a 

retrieval system to a retrieval keyword input to the 
retrieval system by the requester, the retrieval 
keyword from the Web access log; and 

means for calculating a qualitative evaluation 
25 value of the access sequence based on a qualitative 

evaluation rule for defining the qualitative evaluation 
value of a retrieval result of the retrieval system, 
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and creating first relation data indicating a relation 
between the qualitative evaluation value and a 
retrieval keyword which is input in the access 
sequence . 

5 According to still another aspect of the 

invention, a retrieval keyword analyzing system 
comprising : 

means for extracting an access sequence indicating 
a continuous access by a same requester based on a Web 

10 access log which relates first identification data 

indicating an access requester to second identification 
data indicating contents to be accessed; 

means for extracting, when the Web access log 
relates second identification data indicating a 

15 retrieval system to a retrieval keyword which is input 

to the retrieval system by the requester and the 
retrieval keyword is input in the access sequence, the 
retrieval keyword which is input in the access sequence 
from the Web access log; and 

20 means for calculating a qualitative evaluation 

value of the access sequence based on a qualitative 
evaluation rule for defining the qualitative evaluation 
value of a retrieval result of the retrieval system, 
and creating first relation data indicating a relation 

25 between the extracted retrieval keyword and the 

qualitative evaluation value. 

According to still another aspect of the 



invention, a retrieval keyword analyzing system 
comprising : 

means for extracting, based on a Web access log 
which relates first identification data indicating an 
access requester, second identification data indicating 
contents to be accessed, and reference information, 
an access sequence indicating a continuous access 
including an access to the contents to be accessed 
indicated by the second identification data by a same 
requester when the reference information indicates 
a retrieval system; 

means for extracting a retrieval keyword included 
in the reference information when the reference 
information indicates the retrieval system; and 

means for calculating a qualitative evaluation 
value of the access sequence after inputting the 
extracted retrieval keyword based on a qualitative 
evaluation rule for defining the qualitative evaluation 
value of a retrieval result of the retrieval system, 
and creating first relation data indicating a relation 
between the qualitative evaluation value and the 
retrieval keyword corresponding to the access sequence. 

According to still another aspect of the 
invention, a retrieval keyword analyzing system 
comprising : 

means for extracting, based on a Web access log 
which relates first identification data indicating 



an access requester to second identification data 
indicating contents to be accessed, a sub-access 
sequence indicating a continuous access by a same 
requester and having a starting end at which retrieval 
result contents are accessed and a terminal end at 
which a next continuous access starts; 

means for extracting the retrieval keyword when 
the Web access log relates second identification data 
indicating a retrieval system to a retrieval keyword 
input to the retrieval system by the requester; and 

means for calculating a qualitative evaluation 
value of the sub-access sequence based on a qualitative 
evaluation rule for defining the qualitative evaluation 
value of a retrieval result of the retrieval system, 
and creating relation data indicating a relation 
between the extracted retrieval keyword and the 
qualitative evaluation value. . . 

According to still another aspect of the 
invention, a retrieval keyword analyzing method 
comprising the steps of: 

extracting an access sequence indicating a 
continuous access by a same requester based on a Web 
access log which relates first identification data 
indicating an access requester to second identification 
data indicating contents to be accessed; 

extracting, when the Web access log relates second 
identification data indicating a retrieval system to 
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a retrieval keyword which is input to the retrieval 
system by the requester, the retrieval keyword from the 
Web access log; and 

calculating a qualitative evaluation value of the 
5 access sequence based on a qualitative evaluation rule 

for defining the qualitative evaluation value of a 
retrieval result of the retrieval system, and creating 
first relation data indicating a relation between the 
qualitative evaluation value and a retrieval keyword 
10 which is input in the access sequence. 

According to still another aspect of the 
invention, a retrieval keyword analyzing method 
comprising the steps of: 

extracting an access sequence indicating a 
15 continuous access by a same requester based on a Web 

access log which relates first identification data 
indicating an access requester to second identification 
data indicating contents to be accessed; 

extracting, when the Web access log relates second 
20 identification data indicating a retrieval system to 

a retrieval keyword which is input to the retrieval 
system by the requester and the retrieval keyword is 
input in the access sequence, the retrieval keyword 
which is input in the access sequence from the Web 
25 access log; and 

calculating a qualitative evaluation value of the 
access sequence based on a qualitative evaluation rule 
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for defining the qualitative evaluation value of a 
retrieval result of the retrieval system, and creating 
first relation data indicating a relation between the 
extracted retrieval keyword and the qualitative 
5 evaluation value. 

According to still another aspect of the 
invention, a retrieval keyword analyzing method 
comprising the steps of: 

extracting, based on a Web access log which 

10 relates first identification data indicating an access 

requester, second identification data indicating 
contents to be accessed, and reference information, 
an access sequence indicating a continuous access 
including an access to the contents to be accessed 

15 indicated by the second identification data by a same 

requester when the reference information indicates 
a retrieval system; 

extracting a retrieval keyword included in the 
reference information when the reference information 

20 indicates the retrieval system; and 

calculating a qualitative evaluation value of the 
access sequence after inputting the extracted retrieval 
keyword based on a qualitative evaluation rule for 
defining the qualitative evaluation value of a 

25 retrieval result of the retrieval system, and creating 

first relation data indicating a relation between the 
qualitative evaluation value and the retrieval keyword 



corresponding to the access sequence. 

According to still another aspect of the 
invention, a retrieval keyword analyzing method 
comprising the steps of: 

extracting, based on a Web access log which 
relates first identification data indicating an access 
requester to second identification data indicating 
contents to be accessed, a sub-access sequence 
indicating a continuous access by a same requester 
and having a starting end at which retrieval result 
contents are accessed and a terminal end at which 
a next continuous access starts; 

extracting the retrieval keyword when the Web 
access log relates second identification data 
indicating a retrieval system to a retrieval keyword 
input to the retrieval system by the requester; and 

calculating a qualitative evaluation value of the 
sub-access sequence based on a qualitative evaluation 
rule for defining the qualitative evaluation value of a 
retrieval result of the retrieval system, and creating 
relation data indicating a relation between the 
extracted retrieval keyword and the qualitative 
evaluation value. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, 
illustrate embodiments of the present invention and, 



together with the general description given above and 
the detailed description of the embodiments given 
below, serve to explain the principles of the present 
invention in which: 

FIG. 1 is a diagram showing a typical example of 
screen transition of a Web page using a retrieval 
system; 

FIG. 2 is a block diagram showing an example of 
the configuration of a retrieval keyword analysis 
system according to a first embodiment of the present 
invention; 

FIG. 3 is a block diagram showing an example of 
the configuration of a customer site according to the 
first embodiment; 

FIG. 4 is a diagram showing an example of 
information contained in a Web access log 7; 

FIG. 5 is a diagram showing an example of pre- 
processed data generated by a log pre-processing unit 
12; 

FIG. 6 is a diagram showing an example of access 
sequence data; 

FIG. 7 is a diagram showing an example of a 
request to a retrieval system in the Web access log 7; 

FIG. 8 is a diagram showing an example of 
information about the location of the retrieval system 
and query pattern; 

FIG. 9 is a diagram showing an example of 



a parameter extracted by a keyword extracting unit 14 
based on FIGS. 7 and 8; 

FIG. 10 is a diagram showing an example of keyword 

data; 

FIG. 11 is a diagram showing an example which 
relates the after-retrieval browsing time with the 
satisfaction degree ; 

FIG. 12 is a diagram showing an example of 
satisfaction degree data generated by a satisfaction 
degree calculation unit 15; 

FIG. 13 is a diagram showing a result of relation 
of the satisfaction degree data and keyword data; 

FIG. 14 is a diagram showing an example of 
relation data between the retrieval keyword and 
satisfaction degree; 

FIG. 15 is a flow chart showing an example of the 
operation of the retrieval keyword analyzing system . 
according to the first embodiment; 

FIG. 16 is a flow chart showing an example of the 
operation of the keyword extracting unit according to 
the first embodiment; 

FIG. 17 is a flow chart showing an example of the 
operation of the satisfaction degree calculation unit 
according to the first embodiment; 

FIG. 18 is a block diagram showing an example of 
the configuration of a retrieval keyword analyzing 
system according to a second embodiment of the present 
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invention; 

FIG. 19 is a diagram showing an example of need 
value data; 

FIG. 20 is a diagram showing an example of 
5 relation data; 

FIG. 21 is a block diagram showing an example of 
the configuration of a retrieval keyword analyzing 
system according to a third embodiment of the present 
invention; 

10 FIG. 22 is a diagram showing an example of a graph 

displayed according to the third embodiment; 

FIG. 23 is a block diagram showing an example of 
the configuration of a retrieval keyword analyzing 
system according to a fourth embodiment of the present 
15 invention; 

FIG. 24 is a diagram showing an example of 
an access demand page list employed for the . qualitative 
evaluation rule; 

FIG. 25 is a diagram showing an example of a 
20 success degree weighting table for reducing the success 

degree as the number of link clicks from a retrieval 
result page up to an access demand page increases; 

FIG. 2 6 is a diagram showing first intermediate 
generation data; 
25 FIG. 27 is a diagram showing second intermediate 

generation data; 

FIG. 28 is a diagram showing an example of the 
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configuration of a customer site according to a fifth 
embodiment of the present invention; 

FIG. 29 is a diagram showing an example of Web 
access log in a customer site 61; 
5 FIG. 30 is a block diagram showing an example of 

a screen transition from an off-site retrieval system 
to the customer site; 

FIG. 31 is a diagram showing data which relates 
a URL pattern expressing the off-site retrieval system 
10 and query pattern for extracting the retrieval keyword; 

FIG. 32 is a diagram showing an example of access 
sequence data; 

FIG. 33 is a diagram showing an example of keyword 
data generated by the keyword extracting unit 14; 
15 FIG. 34 is a block diagram showing an example of 

a screen transition from a retrieval keyword input 
screen within the customer site to a retrieval result 
page of the off-site retrieval system and then from the 
retrieval result page to the keyword related page 
20 within the customer site; 

FIG. 35 is a diagram showing an example of the 
configuration of a customer site according to a sixth 
embodiment of the present invention; 

FIG. 36 is a diagram showing a specific example of 
25 access sequence/keyword data; 

FIG. 37 is a diagram showing intermediate 
generation data at this stage; 
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FIG . 38 is a block diagram showing an example of 
the configuration of a retrieval keyword analyzing 
system according to a seventh embodiment of the present 
invention; 

FIG. 39 is a flow chart showing an example of the 
operation of the retrieval keyword analyzing system 
according to the seventh embodiment; 

FIG. 40 is a diagram showing an example of 
a calculation result on a need value of a retrieval 
keyword input to access an analyzing object Web site 
and the satisfaction degree; 

FIG. 41 is a diagram showing an example of the 
relation between the need value/satisfaction degree of 
each retrieval keyword and the need value/satisfaction 
degree of each category; 

FIG. 42 is a diagram showing an example of a state 
in which a message is attached to a transition 
condition of the retrieval keyword; 

FIG. 43 is a diagram showing an example of a state 
in which a message is attached to a transition 
condition of the category; 

FIG. 44 is a diagram showing an example of a data 
conversion result by a category forming unit; 

FIG. 45 is a diagram showing an example of the 
data conversion result by the category forming unit; 

FIG. 4 6 is a flow chart showing an example of the 
operation of a trend analyzing unit according to the 
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seventh embodiment ; 

FIG. 47 is a diagram showing an example of 
designation of regions determined by the need boundary 
value and satisfaction degree boundary value; 
5 FIG. 48 is a diagram showing an example of trend 

data created by the trend analyzing unit according to 
the seventh embodiment; 

FIG. 49 is a diagram showing another example of 
the message to be attached when the region is shifted 
10 according to the seventh embodiment; 

FIG. 50 is a diagram showing an example of a graph 
displayed by an output processing unit according to the 
seventh embodiment ; 

FIG. 51 is a block diagram showing an example of 
15 the configuration of a trend analyzing unit according 

to an eighth embodiment of the present invention; 

FIG. 52 is a diagram showing the relation between 
a specific example of a moving distance threshold and 
the operation of a trend analyzing unit 79; 
20 FIG. 53 is a diagram showing an example of message 

data 82; 

FIG. 54 is a diagram showing a specific example of 
the relation between a message and the moving 
direction; 

25 FIG. 55 is a diagram showing an example of trend 

data created by the trend analyzing unit according to 
the eighth embodiment; 



FIG. 56 is a flow chart showing an example of the 
operation of a retrieval keyword analyzing system 
according to the eighth embodiment; 

FIG . 57 is a diagram showing an example of trend 
data output by an output processing unit according to 
the eighth embodiment; 

FIG. 58 is a diagram showing an example of a state 
of an access sequence in case where a customer site is 
provided with a retrieval system; 

FIG. 59 is a diagram showing an example of a state 
of an access sequence in case where the retrieval 
system exists out of the customer site; 

FIG. 60 is a diagram showing an example of a state 
of an access sequence in case where the retrieval 
system exists out of the customer site while a 
retrieval result page exists halfway of the access 
sequence within the customer site; 

FIG. 61 is a diagram showing an example of a state 
in which multiple retrievals are carried out in an 
access sequence in case where the retrieval system 
exists within the customer site; 

FIG. 62 is a diagram showing an example of a state 
in which multiple retrievals are carried out in an 
access sequence in case where the retrieval system 
exists out of the customer site; 

FIG. 63 is a diagram showing an example of a state 
in which the retrieval is carried out halfway of 
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an access sequence using both the retrieval system 
within the customer site and the retrieval system out 
of the customer site; 

FIG. 64 is a diagram showing an example of the 
5 relation between a sub-access sequence extracted based 

on a retrieval result page by the retrieval system 
within the customer site and an after-retrieval 
browsing time; 

FIG. 65 is a diagram showing an example of the 
10 relation between a sub-access sequence extracted based 

on a retrieval result page by the retrieval system out 
of the customer site and an after-retrieval browsing 
t ime ; 

FIG. 66 is a block diagram showing an example of 
15 the configuration of a retrieval keyword analyzing 

system according to a ninth embodiment of the present 
invention; 

FIG. 67 is a block diagram showing a specific 
example of a sub-access sequence extraction unit 86 
20 according to the ninth embodiment; 

FIG. 68 is a diagram showing access sequence data 
created by an access sequence extracting unit 90; 

FIG. 69 is a block diagram showing a specific 
example of a sub-access sequence determining unit 91 
25 according to the ninth embodiment; 

FIG. 70 is a temporary first table generated as 
a result of processing; 
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FIG. 71 is a diagram showing an example of 
a screen transition of an access sequence; 

FIG. 72 is a temporary second table generated as 
a result of processing; 
5 FIG. 73 is an example of specific information 95 

for specifying the retrieval system out of the customer 
site; 

FIG. 74 is a temporary third table generated as 
a result of processing; 
10 FIG. 75 is an extracted example of sub-access 

sequence data; 

FIG. 76 is an example of extracted satisfaction 
degree data; and 

FIG. 77 is a flow chart showing an example of the 
15 operation of the retrieval keyword analyzing system 

according to the ninth embodiment. 

DETAILED DESCRIPTION OF THE INVENTION 
An embodiment of a retrieval keyword analyzing 
system and method according to the present invention 
20 will now be described with reference to the accompany- 

ing drawings. The Web site mentioned here refers to 
a group of Web page including at least one Web page. 
First Embodiment 

This embodiment relates to a retrieval keyword 
25 analyzing system for obtaining a qualitative evaluation 

value to a retrieval result based on a retrieval 
keyword input by a browsing person with a high degree 
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of accuracy by analyzing a browsing action (including 
screen transitions over two or more pages) of the 
browsing person, from a retrieval result page 
indicating a retrieval result by the retrieval system. 
5 As described above, the retrieval system extracts 

information about the keyword related pages determined 
to be related to the retrieval keyword, corresponding 
to a retrieval keyword input by the browsing person and 
makes a list thereof so as to present to the browsing 

10 person. The browsing person inputs a retrieval keyword 

freely to the retrieval system based on his or her 
intention. Thus, input frequencies of various kinds of 
retrieval keywords do not reach a specific rate among 
those various kinds of the retrieval keywords, so that 

15 a certain amount of differential occurs. Therefore, 

there occurs a difference in qualitative evaluation 
value which evaluates a retrieval result by a retrieval 
keyword input to access a customer site quantitatively 
depending upon each retrieval keyword. The quantita- 

20 tive evaluation value includes a need value expressing 

the amount, number and multiplicity of needs on the 
retrieval result for each retrieval keyword, and for 
example, the number of inputs of the retrieval keyword 
is adopted as the need value. Additionally, examples 

25 of the quantitative evaluation value include the number 

of keyword related pages extracted based on the 
aforementioned retrieval keyword and the number of 
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clicks on the retrieval result page. 

On the other hand, the keyword related page 
retrieved based on the retrieval keyword is not always 
contents desired by the browsing person. Thus, the 
5 meaning of obtaining the qualitative evaluation value 

which evaluates the retrieval result qualitatively on 
a basis of the retrieval keyword input to access the 
customer site is large. 

As an example of the qualitative evaluation value, 

10 the degree of effect which is a degree indicating how 

effectively the retrieval result based on the retrieval 
keyword functions is available. Further, as a specific 
example of the degree of effect, the degree of 
satisfaction indicating how a browsing person using the 

15 retrieval system is satisfied with information service 

provided by the retrieval system to the retrieval 
keyword is available. As another example of the degree 
of effect, the degree of success indicating how many 
browsing persons in its own site access a Web page 

20 which a Web site operator wants to be accessed is 

available. Other examples of the qualitative 
evaluation value include the degree of importance 
indicating how important the browsing person considers 
a retrieval result by the retrieval keyword is 

25 available. There occurs a difference in the 

qualitative evaluation value among the retrieval 
keywords depending on the performance of the retrieval 



system, the quality of listed keyword related pages, 
the contents and the like. 

For a manager of the Web page or Web site, 
investigating the qualitative evaluation value is 
effective for grasping how much the Web page, Web site 
and the retrieval system managed by himself satisfy the 
browsing persons and effective for improvement of the 
design and contents of the Web page, Web site and the 
retrieval system. 

Although in this embodiment, a case for obtaining 
the degree of satisfaction as a qualitative evaluation 
value will be described, the same thing is said about 
a case of obtaining other qualitative evaluation value 
instead of the degree of satisfaction. 

FIG. 2 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
system. A storage device 4 stores a Web access log 7 
of a customer site 6 which is managed by a customer 5 
who is a manager of an investigation object Web site. 

FIG. 3 is a block diagram showing an example of 
the configuration of the customer site 6. The customer 
site 6 corresponds to an analysis object site and 
includes an on-site retrieval system 6a within the 
customer site 6 and one or more Web pages Pi to P n . 
The on-site retrieval system 6a retrieves the Web 
page within a specific site. Referring to FIG. 3, the 
on-site retrieval system 6a retrieves the Web pages P]_ 
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to P n of the customer site 6. 

Of general browsing persons 8, a browsing person 
who accesses the customer site 6 is called customer 
site browsing person 8a. 
5 FIG. 4 shows an example of the Web access log 7. 

The Web access log 7 contains a record comprising 
a host name or IP address, information about date and 
time when the customer site browsing person 8a accesses 
the customer site 6, a request (URL) issued by the 

10 customer site browsing person 8a, reference information 

(known as referrer) , ID (user ID) of the customer site 
browsing person 8a who accesses and the like, which are 
recorded each time when the customer site browsing 
person 8a accesses the customer site 6. 

15 The reference information refers to information 

indicating through which Web page or pages (link) the 
accessed Web page is accessed. In FIG._4, description 
of specific values is omitted about user ID of the 
customer site browsing person 8a and reference 

20 information. 

A retrieval keyword analyzing system 9 reads out 
a retrieval keyword analyzing program 11 recorded in 
a recording medium 10 and executes it. 

When the retrieval keyword analyzing program 11 is 

25 read by the system 9 and executed, a log pre-processing 

unit 12, an access sequence extracting unit 13, a 
keyword extracting unit 14, and an evaluation value 



calculation unit 37 are realized. 

The evaluation value calculation unit 37 includes 
a satisfaction degree calculation unit 15 and a 
satisfaction degree/keyword relating unit 16. 

Data created by the respective units 12 to 16 are 
recorded in a storage device 38. The respective units 
12 to 16 are capable of reading data stored in the 
storage device 38. As the storage device 38, for 
example, an internal memory and the like are employed. 
Exchange of various kinds of data among the respective 
units 12 to 16 may be carried out through the storage 
device 38. In this case, a data sender stores data to 
be sent in the storage device 38 and a data receiver 
reads out data from the storage device 38. 

The log pre-processing unit 12 inputs information 
necessary for the retrieval keyword analyzing system 9 
based on the Web access log 7 stored in the storage 
device 4 . 

The log pre-processing unit 12 provides each page 
access with an access identifier (view ID) which has no 
duplicate based on the input information. FIG. 5 shows 
an example of the pre-processed data generated by the 
log pre-processing unit 12. 

The access sequence extracting unit 13 extracts a 
sequence of sequential Web pages (hereinafter referred 
to as "access sequence") accessed by the customer site 
browsing person 8a and provides each access sequence 



- 32 - 



10 



with an access sequence identifier which has no 
duplicate so as to generate access sequence extraction 
data. The access sequence mentioned here refers to 
a continuous access by the same browsing person or 
browsing persons regarded as the same person, that is, 
the same access person. 

If combinations of the host name or IP address and 
a user agent coincides with each other, the access 
sequence extracting unit 13 handles that the access 
sequence is accessed by the same access person and 
assigns a combination of the host name or IP address 
and the user agent with an access requesting person 
identifier (referred to access person identifier) and 
then extracts one or more Web pages accessed by the 
15 same access person continuously as an access sequence. 

The access sequence extracting unit 13 extracts 
an access sequence out of a sequential page . access 
according to a predetermined access sequence extraction 
rule and creates an access sequence data indicating an 
20 extraction result of the access sequence. For example, 

a rule for extracting a session used for a general Web 
access log analysis is employed as an access sequence 
extracting rule. More specifically, if it takes more 
than 30 minutes from an access to a Web page by 
25 a browsing person to an access to a next Web page 

(including a case where screen transition to a next Web 
page does not occur) , an interval between those 



accesses is regarded as a session border (or a session 
terminal end) and then, an interval between session 
borders is extracted as a session. The session is used 
as an access sequence. 

A time period for determining the border between 
one access sequence and another access sequence is not 
limited to the above-mentioned 30 minutes but is set 
up freely. That is, if multiple accesses are made by 
the same access person within a predetermined time 
interval, it may be possible to adopt a rule which 
determines that the multiple accesses are included in 
the same access sequence. 

When the access sequence is extracted, it may be 
possible to determine the identity of the access person 
based on browsing person's ID (user ID) or Cookie 
information recorded in the Web access log 7. 

FIG. 6 shows an example of access sequence data. 
The access sequence data shown in FIG. 6 includes a 
record comprising an access sequence identifier (visit 
ID) for identifying each access sequence, an access 
person identifier (visitor ID) for identifying a 
combination of the host name and user agent, and the 
like . 

The keyword extracting unit 14 extracts a 
retrieval keyword input by the customer site browsing 
person 8a in the on-site retrieval system 6a from the 
pre-processed data generated by the log pre-processing 



unit 12 and creates keyword data indicating a retrieval 
keyword extraction result. 

FIG . 7 shows examples of a request to the 
retrieval system included in the Web access log 7. 
An example 1 indicates a request to a basic retrieval 
system including a retrieval keyword *xxxx." In an 
example 2, a retrieval keyword ^yyyy" and the 10th page 
of its retrieval result are requested. In an example 
3, a code indicating a retrieval keyword * 9 k> (apple) " 
is contained in the request. 

To extract a retrieval keyword from the Web access 
log 7 , information about a query pattern expressing 
parameters indicating the location of a retrieval 
system and a retrieval keyword is used. 

FIG. 8 shows an example of information about the 
location of the retrieval system and query pattern. 
That is, the. keyword extracting unit 14 extracts 
an access through the retrieval system from the 
pre-processed data on a basis of information about 
the location of the retrieval system. 

The keyword extracting unit 14 extracts a 
retrieval keyword based on the information about query 
pattern. FIG. 9 shows examples 1 to 3 of parameters 
extracted by the keyword extracting unit 14 based on 
the examples shown in FIGS. 7 and 8. 

The extracted parameters include parameters 
encoded as shown in an example 3 in FIG. 9. 
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The keyword extracting unit 14 decodes an encoded 
parameter to a readable character string so as to 
generate keyword data. 

FIG. 10 shows an example of keyword data. The 
5 keyword data of FIG. 10 includes a record comprising 

an access identifier and a retrieval keyword input upon 
an access corresponding to the access identifier. 

The satisfaction degree calculation unit 15 
calculates the degree of satisfaction of a browsing 
10 person based on access sequence data generated by the 

access sequence extracting unit 13. 

To calculate the satisfaction degree, a 
qualitative evaluation rule indicating how to calculate 
the satisfaction degree is defined. 
15 For example, as the qualitative evaluation rule, 

it is defined a rule that the longer a browsing 
retrieval time (hereinafter referred to as * after- 
retrieval browsing time" ) in the customer site 6 by the 
customer site browsing person 8a after a retrieval 
20 keyword is input to the on-site retrieval system 6a is, 

the higher the satisfaction degree is. 

FIG. 11 shows an example of the relation between 
the after-retrieval browsing time and the satisfaction 
degree. The after-retrieval browsing time is a time 
25 interval obtained by subtracting a time of access on 

a first keyword related page from a last access time 
in an access sequence for obtaining the satisfaction 



degree. However, if the access sequence ends without 
any screen transition from the retrieval result page to 
the keyword related page, the after-retrieval browsing 
time is defined as *no browsing." If a screen 
transition occurs from the retrieval result page to 
the keyword related page and its access sequence ends 
without browsing any Web page in another site, the 
after-retrieval browsing time is defined as "browsing 

only one page." 

That is, the satisfaction degree calculation unit 
15 reads access sequence data and calculates the after- 
retrieval browsing time of each access sequence. 

The satisfaction degree calculation unit 15 reads 
correspondence data between the after-retrieval 
browsing time and the satisfaction degree shown in 
FIG. 11, and calculates the satisfaction degree of each 
access sequence.. 

FIG. 12 shows an example of satisfaction degree 
data calculated by the satisfaction degree calculation 
unit 15. 

The satisfaction degree data of FIG. 12 contains 
a record comprising an access identifier and a 
satisfaction degree corresponding to an access sequence 
identifier which the access belongs to. 

The satisfaction degree/keyword relating unit 16 
relates the satisfaction degree data calculated by the 
satisfaction degree calculation unit 15 to keyword data 
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generated by the keyword extracting unit 14, calculates 
the satisfaction degree of each retrieval keyword, 
relates the satisfaction degree to the retrieval 
keyword and creates relation data. 
5 The satisfaction degree/keyword relating unit 16 

reads satisfaction degree data and keyword data. 

The satisfaction degree/keyword relating unit 16 
relates the satisfaction degree data to the keyword 
data based on the access identifier. 

10 FIG. 13 shows a relation between the satisfaction 

degree data and the keyword data. The satisfaction 
degree/keyword relating unit 16 obtains an average of 
the satisfaction degree of each retrieval keyword to 
create relation data. 

15 FIG. 14 shows an example of the relation data. 

FIG. 15 is a flow chart showing an example of an 
operation of the retrieval keyword analyzing system 9. . 

In step SI, the log pre-processing unit 12 inputs 
necessary information from the information contained in 

20 the Web access log 7 to create pre-processed data. 

In step S2, the access sequence extracting unit 13 
extracts an access sequence based on the pre-processed 
data and access sequence extracting rule to create 
access sequence data. 

25 In step S3, the satisfaction degree calculation 

unit 15 calculates the satisfaction degree of each 
access sequence based on the access sequence data and 



the satisfaction degree calculation rule to create 
satisfaction degree data. 

In step S4, the keyword extracting unit 14 
extracts the retrieval keyword input to the on-site 
retrieval system 6a based on the pre-processed data to 
create keyword data. 

In step S5, the satisfaction degree/keyword 
relating unit 16 calculates the satisfaction degree of 
each retrieval keyword based on the satisfaction degree 
data and keyword data to create relation data. 

Step S4 may be executed prior to step S2 and step 
S3, after those steps or in parallel. 

FIG. 16 is a flow chart showing an example of the 
operation of the keyword extracting unit 14. 

In step Tl, the keyword extracting unit 14 reads 
information about the location of retrieval system and 

query pattern. 

In step T2, the keyword extracting unit 14 reads 
a record from one Web access log 7 preliminarily 
processed by the log pre-processing unit 12. 

In step T3, the keyword extracting unit 14 
determines whether or not a request included in the 
read record contains the location of the retrieval 
system. 

When it is determined that the request includes 
the location of the retrieval system, in step T4, the 
keyword extracting unit 14 extracts a parameter from 
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the request based on a query pattern corresponding to 
the location of the retrieval system. 

When it is not determined that the request 
includes the location of the retrieval system, the 
5 keyword extracting unit 14 repeats processing from 

step T2. 

In step T5, the keyword extracting unit 14 
determines whether or not decoding is necessary for the 
extracted parameter. 
10 When decoding is necessary, in step T6, the 

keyword extracting unit 14 decodes the extracted 
parameter . 

In step T7, the keyword extracting unit 14 
determines whether or not a record at an end is read 
15 from the Web access log 7 which is preliminarily 

processed by the log pre-processing unit 12. 

If it is determined that the record at the end is 
not read, the keyword extracting unit 14 repeats 
processing from step T2 . 
20 When it is determined that the record at the end 

is read, in step T8, the keyword extracting unit 14 
creates keyword data with the extracted parameter as 
a retrieval keyword. 

FIG. 17 is a flow chart showing an example of 
25 the operation of the satisfaction degree calculation 

unit 15. 

In step Ul, the satisfaction degree calculation 
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unit 15 reads access sequence data generated by the 
access sequence extracting unit 13. 

In step U2, the satisfaction degree calculation 
unit 15 calculates after-retrieval browsing time of 

5 each access sequence. 

In step U3, the satisfaction degree calculation 
unit 15 reads data about the relation between the 
after-retrieval browsing time and the satisfaction 
degree . 

10 m step U4, the satisfaction degree calculation 

unit 15 obtains a satisfaction degree corresponding to 
the after-retrieval browsing time of each access 
sequence . 

In step U5, the satisfaction degree calculation 
15 unit 15 creates satisfaction degree data indicating the 

satisfaction degree of each access sequence. 

Step U3 may be executed before step Ul and step U2 

or in parallel. 

In this embodiment described above, as an analysis 

20 result about the retrieval keyword, how the customer 

site browsing person 8a is satisfied with a retrieval 
result by its retrieval keyword is investigated and not 
only a quantitative evaluation value but also a high 
precision qualitative evaluation value upon the 

25 retrieval keyword is analyzed. 

According to this embodiment, for example, the 
customer 5 knows how the customer site browsing person 
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8a is satisfied with the retrieval result 
quantitatively. For example, as evident from FIG. 14, 
while the satisfaction degree of the customer site 
browsing person 8a on a retrieval result of a retrieval 
5 keyword * (apple) " is high, the retrieval result by 

a retrieval keyword ^^fENSf (sugar ) " or a retrieval keyword 
* l^lSf ^ (meat and vegetable) " provides a low satisfaction 
degree of the customer site browsing person 8a. 

As the qualitative evaluation value, in addition 

10 to the degree of effect represented by the satisfaction 

degree or the like, for example, the degree of 
importance or the degree of convenience is considered. 

The degree of importance refers to an index 
indicating how important the Web site browsing person 

15 takes matters relating to the retrieval keyword as. 

The degree of convenience refers to an index 
indicating how easily the Web site browsing person 
browses matter or writes the matter to the Web site and 
the like relating to the retrieval keyword. 

20 The degree of importance and the degree of 

convenience is obtained according to the after- 
retrieval browsing time like the degree of 
satisfaction. 

Which of the satisfaction degree, the degree of 

25 importance and the degree of convenience the after- 

retrieval browsing time will be used to calculate is 
selected appropriately depending on a Web site which is 



an analyzing object, the character of a browsing person 
or viewpoint of an analyzer. 

For example, it is considered that in case where 
there exist a number of competitive similar sites in 
an electric commerce (EC) site which sells products, if 
the contents relating to a retrieval keyword do not 
coincide with a customer's desire, the customer gives 
up his browsing in a relatively short time and leaves 
the site to search for another site. In this case, 
it is appropriate to use the after-retrieval browsing 
time as the satisfaction degree. For example, if 
an analysis result that 'the degree of satisfaction to 

(honey) is low" is obtained because the after- 
retrieval browsing time to the keyword (honey) " is 
short, this result is effective as a reason for 
determining that the necessity of taking measures for 
raising the satisfaction degree by improving the 
content relating to (honey) " is high. 

On the other hand, if there exist few other 
similar competitive sites or if provided contents are 
browsed due to the rational necessity rather than a 
fact that the contents satisfy a browsing person's 
desire or if there exist a number of browsing persons 
who want to obtain information about the retrieval 
keyword from that Web site, it is considered that the 
browsing person stays in the site for a long time and 
browses its information depending on how important he 



takes the content relating to the retrieval keyword. 
Therefore, it may be sometimes appropriate to use the 
after-retrieval browsing time to calculate the degree 
of importance. In this case, if an analysis result 
that the degree of importance to a certain retrieval 
keyword is low because the after-retrieval browsing 
time to that retrieval keyword is short is obtained, 
this result is effective as a reason for determining 
that the contents have a low necessity for taking a 
measure for its improvement. 

Further, the degree of convenience is effective as 
an index for evaluating how easily the browsing person 
understands provided contents or how easily the 
information is input. 

For example, in a Web site in which the contents 
of questionnaire are changed depending on the retrieval 
keyword, if the after-retrieval browsing . time is long, 
it is considered that it takes labor and time to input 
an answer to the questionnaire and that its degree of 
convenience is low. 

If there are contents having a low degree of 
convenience, this is effective as a reason for 
determining that the necessity of taking measure for 
improving that degree of convenience is high. 
Second Embodiment 

In this embodiment, a modification of the 
retrieval keyword analyzing system according to the 
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first embodiment will be described. Although in this 
embodiment, a case where the degree of satisfaction is 
obtained as the qualitative evaluation value while the 
need value is obtained as the quantitative evaluation 
5 value will be described, the same thing is said if it 

is intended to obtain other qualitative evaluation 
value and quantitative evaluation value. 

FIG. 18 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
10 system according to the second embodiment. 

A retrieval keyword analyzing system 18 reads out 
a retrieval keyword analyzing program 20 recorded in 
a recording medium 19 and executes it. 

When the retrieval keyword analyzing program 20 
15 is read in the system 18 and executed, the log pre- 

processing unit 12, the access sequence extracting unit 
13, the keyword extracting unit 14 and an. evaluation 
value calculation unit 39 are realized. 

The evaluation value calculation unit 39 includes 
20 the satisfaction degree calculation unit 15, a need 

value calculation unit 21 and a satisfaction 
degree/need value relating unit 22. 

Data obtained by the need value calculation unit 
21 and the satisfaction degree/need value relating unit 
25 22 are stored in the storage device 38. The need value 

calculation unit 21 and the satisfaction degree/need 
value relating unit 22 are capable of reading data 
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stored in the storage device 38. 

The need value calculation unit 21 calculates a 
need value for each retrieval keyword based on keyword 
data generated by the keyword extracting unit 14. 
5 To calculate the need value, a quantitative 

evaluation rule expressing how the need value is 
calculated is defined. 

For example, as the quantitative evaluation rule, 
the value expressing a ratio with a percentage of each 
10 retrieval keyword to a total number of the retrieval 

keywords is defined as the need value. 

The need value calculation unit 21 reads keyword 
data generated by the keyword extracting unit 14 and 
counts the input number of each retrieval keyword. 
15 The need value calculation unit 21 calculates a 

total input number of all the retrieval keywords from 
the input numbers of respective retrieval keywords. 

The need value calculation unit 21 expresses 
a ratio with a percentage of each retrieval keyword 
20 to the retrieval keywords based on the input number of 

the all retrieval keywords and the input number of the 
respective retrieval keywords. 

The need value calculation unit 21 outputs need 
value data indicating the need value of each retrieval 
25 keyword. 

FIG. 19 shows an example of need value data. 
The satisfaction degree/need value relating unit 22 



reads satisfaction degree data generated by the 
satisfaction degree calculation unit 15 and need value 
data generated by the need value calculation unit 21. 

The satisfaction degree/need value relating unit 
22 relates the satisfaction degree data to the need 
value data for each retrieval keyword and outputs 
relation data expressing the need value and 
satisfaction degree of each retrieval keyword. 

FIG. 20 shows an example of the relation data. 

According to the second embodiment, the customer 5 
knows a retrieval keyword which needs to be taken 
measures quickly by referring to the qualitative 
evaluation value (for example, satisfaction degree) and 
quantitative evaluation value (for example, need 
value) . 

For example, referring to the example shown in 
FIG. 20, it .is .interpreted that for the customer 5, 
retrieval keywords *#PW (sugar )" and * 03 KP M (meat and 
vegetable)" indicate similar degrees of satisfaction, 
which are lower than the satisfaction degree of other 
retrieval keywords, the * 0*1 If ^ (meat and vegetable) " has 
a higher need value than ^ftt (sugar) ." 

As a result, for the customer 5, although the 
satisfaction degree for the retrieval keyword *#ifiS 
(sugar)" is low, its retrieval need is low (in the case 
of this embodiment, the number of browsing persons on 
a retrieval result page by the retrieval keyword 



(sugar)" is small) and therefore, it is considered that 
its influence is relatively low. 

Contrary to this, for the customer 5, although the 
retrieval keyword * l^llf M (meat and vegetable)" has a 
satisfaction degree about as low as the sugar)," 
it has retrieval needs (in case of this embodiment, the 
number of browsing persons on a retrieval result page 
by the retrieval keyword * ^ (meat and vegetable)" is 
large), it is considered that its influence is high. 

Thus, the customer 5 determines it necessary to 
take measures such as increasing contents relating to 
the * I^IIfH (meat and vegetable)" and change the on-site 
retrieval system 6a and Web pages Pi to P n to meet a 
desire of the browsing person quickly and accurately. 

The need value calculating method is changed 
f ree ly by changing setting of the keyword extracting 
unit 14 and the need value calculation, unit 21. For 
example, the need value may be calculated based on the 
number of customer site browsing persons 8a who access 
keyword related pages obtained by inputting a retrieval 
keyword or the number of accesses made on the keyword 
related pages. For example, the need value may be 
calculated based on the number of browsing persons who 
access according to an access sequence or the frequency 
(number of browses) of the access made according to the 

access sequence. 

As the quantitative evaluation value, a chance 



value as well as the need value is available. The 
chance value is an index indicating how many business 
chances are gained in viewpoints of the retrieval 
keyword when a Web site achieves its object. For 
example, for an EC site which sells foods, if there 
exist a number of browsing persons who visit through 
the retrieval keyword (sugar) ," it comes that the 

site obtains corresponding many business chances for 
selling sugar. 

It may be possible to calculate the chance value 
based on the quantity used for calculating the need 
value like the input number of each retrieval keyword. 

Which is adopted as the input number of each 
retrieval keyword the need value or the chance value 
depends on the characteristic of the browsing person of 
the Web site or viewpoint of the analyzer. 

For example, for a Web site operated to provide, 
with information about commodity to know its reaction 
rather than sell just the commodity, it is appropriate 
to handle the input number of each retrieval keyword as 
the need value. 

On the other hand, for a Web site mainly aiming at 
selling the commodity itself on line, it is appropriate 
to handle the input number of each retrieval keyword as 
the chance value and employ this chance value as an 
index indicating the amount of chances for selling 
products relating to each retrieval keyword. 



Third Embodiment 

In this embodiment, a modification of the 
retrieval keyword analyzing system according to the 
second embodiment will be described. 

FIG. 21 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
system. 

A retrieval keyword analyzing system 24 reads out 
a retrieval keyword analyzing program 26 recorded in 
a recording medium 25 and executes it. 

When the retrieval keyword analyzing program 26 is 
read into the system 24 and executed, a graphing unit 
27 is realized in addition to the log pre-processing 
unit 12, the access sequence extracting unit 13, the 
keyword extracting unit 14 and the evaluation value 

calculation unit 39. 

The graphing unit 27 reads relation data generated 
by the satisfaction degree/need value relating unit 22. 

The graphing unit 27 creates output data 28 
expressing the need value/satisfaction degree of each 
retrieval keyword with a graph. 

The graphing unit 27 graphs relation data in which 
the satisfaction degree of each retrieval keyword is 
related to the need value according to a specified 
graphing rule and a parameter employed for the graphing 
procedure . 

For example, the graphing unit 27 creates a 
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scattering plot. In this case, with the satisfaction 
degree and the need value as parameters, by setting one 
axis (X-axis) of the scattering plot to the need value 
and the other axis (Y-axis) to the satisfaction degree, 
points indicating respective retrieval keywords are 
plotted based on the need value/satisfaction degree 
value in the relation data. 

FIG. 22 is an example of a graph indicating the 
satisfaction degree and the need value of each 

retrieval keyword. 

Because in this embodiment, the satisfaction 
degree and the need value of each retrieval keyword are 
graphed, a visual analysis result is provided for the 
customer 5. 

Therefore, the customer 5 obtains an analysis 
result which the human being interprets and judges 

instinctively. 

For example, because according to the graph shown 

in FIG. 22, a retrieval keyword * 9 k> w (apple) " 
indicates a high need value and a high satisfaction 
degree while retrieval keywords (super market)" 

and m (meat and vegetable)" indicate high need 
values but low satisfaction degree, it is interpreted 
that the customer 5 needs to change the on-site 
retrieval system 6a and the Web pages Pq_ to P n quickly 
to take appropriate measures. 

By changing the setting of the graphing unit 27 of 



this embodiment, the values of the graph axes is 

converted to improve a graph indication effect. 

For example, the graphing unit 27 may normalize the 

need value and satisfaction degree between 0 and 1. 

The need value and satisfaction degree may be subjected 

to logarithmic treatment and expressed with a graph. 

Further, the graphing unit 27 may express the need 

value and satisfaction degree with a bar graph. 

Further, the graphing unit 27 may add an appropriate 

auxiliary line to the graph. 

Fourth Embodiment 

In this embodiment, a modification of the 
retrieval keyword analyzing system according to the 
first to third embodiments will be described. Although 
hereinafter, the modification of the first embodiment 
will be described, the same modification is applied to 
the second and third embodiments. 

Although in this embodiment, a case for obtaining 
the degree of success in the qualitative evaluation 
values will be described, the same thing is said about 
other cases for obtaining other qualitative evaluation 
value instead of the degree of success. 

FIG. 23 is a block diagram showing an example of 
the retrieval keyword analyzing system. 

A retrieval keyword analyzing system 29 reads out 
a retrieval keyword analyzing program 31 recorded in 
a recording medium 30 and executes it. 
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When the retrieval keyword analyzing program 31 
is read in the system 29 and executed, the log 
pre-processing unit 12, the access sequence extracting 
unit 12, the keyword extracting unit 14 and an 
evaluation value calculation unit 40 are realized. 

The evaluation value calculation unit 40 includes 
a success degree calculation unit 32 and a success 
degree/keyword relating unit 41. 

The success degree calculation unit 32 calculates 
the degree of success based on the access sequence 
data obtained by the access sequence extracting unit 13 
and keyword data obtained by the keyword extracting 
unit 14. 

As the qualitative evaluation rule, a rule having 
following contents is defined. 

The customer 5 creates a list (hereinafter 
referred to as "access demand page list") in which, 
identification information about the Web pages desired 
to be accessed by the browsing person (hereinafter 
referred to as ' access desired page") is related to 
typical retrieval keywords (retrieval keywords of 

analysis candidates) . 

If the customer site browsing person 8a accesses 
an access desired page through a link on the retrieval 
result page, the success degree is counted up. 

However, as the number of clicks from the 
retrieval result page to the access desired page 
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increases, the success degree is reduced* 

A retrieval keyword which is not specified by the 

customer 5 is classified as ^others" and provide with 

no success degree and taken out of evaluation. 

FIG. 24 shows an example of an access demand page 

list which is used in the above-described qualitative 

evaluation rule. 

Multiple access desired pages may correspond to 

a single retrieval keyword and multiple retrieval 

keywords may correspond to a single access desired 

page . 

FIG. 25 shows an example of a success degree 
weighting table for reducing the success degree as 
the number of clicks from a retrieval result page to 
an access desired page increases. 

The success degree calculation unit 32 extracts 
access sequence data generated by the. access sequence 
extracting unit 13, keyword data generated by the 
keyword extracting unit 14, an access demand page list 
and a success degree weighting table. - 

The success degree calculation unit 32 may extract 
only a combination of the retrieval keyword and the 
access identifier in the keyword data instead of 
extracting all keyword data. 

The success degree calculation unit 32 extracts 
a retrieval keyword and its access identifier (view ID) 
contained in the retrieval keyword in the access demand 
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page list from the keyword data. 

The success degree calculation unit 32 extracts 
an access sequence identifier related to the access 
identifier extracted by the aforementioned work in the 
access sequence data. 

The success degree calculation unit 32 extracts 
access identifier and request which are related to the 
extracted access sequence identifier from the access 
sequence data so as to extract a retrieval keyword 
contained in the request. 

FIG. 26 shows a first intermediate generation data 

at this stage. 

The success degree calculation unit 32 
investigates whether an access desired page to each 
retrieval keyword is accessed in an access sequence in 
which the retrieval keyword is input. 

If any access desired page is accessed, the 
success degree calculation unit 32 investigates at how 
many clicks after the retrieval keyword is input the 
access desired page is accessed. 

Even if the access desired page is accessed before 
the retrieval keyword is input, that access is not 
considered upon calculation of the success degree. 

In an example of FIG. 26, an access desired page 
identifier to a retrieval keyword * K) A/ ^ (apple) " 
relating to an access identifier *view22" is 
V apple/index. html." The access desired page 
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identifier m /apple /index . html" corresponds to an access 
identifier *view28" relating to the same access 
sequence identifier *visit6" as the access identifier 
*view22 ." 

The access desired page identifier 
X V apple/index . html" is input two clicks after the 
retrieval keyword * 9 A>^T (apple) " is input. 

The success degree calculation unit 32 calculates 
a success degree based on the relation between the 
success degree and the number of clicks from the 
retrieval result page. 

If examples of FIGS. 26 and 25 are applied, 
a success degree ^80" is provided for the retrieval 
keyword m 19 Av^T (apple)" in an access sequence expressed 
by the access sequence identifier ^visits." 

FIG. 27 shows a second intermediate generation 
data at this stage. 

The success degree calculation unit 32 creates 
success degree calculating data in which an average of 
the success degree is obtained for each retrieval 
keyword. 

The success degree/keyword relating unit 41 
relates success degree calculating data generated by 
the success degree calculation unit 32 to keyword data 
generated by the keyword extracting unit 14 so as to 
calculate the success degree of each retrieval keyword, 
and relates the success degree to the retrieval keyword 



to create relation data. 

The relation data take the same style as FIG. 14 
except that the item * satisfaction degree" is replaced 
with the item * success degree." 

Using the success degree calculating method of 
this embodiment described above makes it possible to 
know whether an appropriate guidance is made to a Web 
page which is desired to be accessed by the customers 
corresponding to a certain retrieval keyword. 
Fifth Embodiment 

In this embodiment, a modification of the 
retrieval keyword analyzing system according to the 
first to fourth embodiment will be described. 

In this embodiment, a retrieval keyword analyzing 
system in a case where the retrieval system is located 
out of the customer site 6 will be explained. 

Although hereinafter a modification of the first 
embodiment will be described, the same modification is 
made for the second to fourth embodiments also. 

FIG. 28 is a diagram showing an example of the 
configuration of the customer site. 

A customer site 61 has one or more Web pages to 
P n . Some Web pages in the customer site 61 are 
retrieval objects of multiple off-site retrieval 
systems 34^ to 34 n (which are out of the customer site 
61) operated by third management parties other than the 
customer 5. 
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If a retrieval keyword is input, the off-site 
retrieval systems 34^ to 34 n display a retrieval result 
page including a link to the keyword related page. 

Because according to this embodiment, the 
operating body of the customer site 61 is different 
from that of the retrieval systems 34 ]_ to 34 n , it is 
difficult to acquire the Web access logs of the 
retrieval systems 34]_ to 34 n unlike the first to fourth 
embodiments . 

Thus, according to this embodiment, the retrieval 
keyword is analyzed using not the Web access log of the 
retrieval systems 34^ to 34 n but reference information 
included in the Web access log of the customer site 61. 

FIG. 29 shows an example of the Web access log of 
the customer site 61 . 

FIG. 30 is a block diagram showing an example in 
which a browsing person moves from the off-site 
retrieval system 34]_ to the customer site 61 for 
browsing. 

If a retrieval keyword is input to a retrieval 
keyword input screen 35 by a browsing person, 
a retrieval result page 36 is created. The URL 
presenting the retrieval result page 36 may contain the 
retrieval keyword input to the retrieval keyword input 
screen 35. 

When a link of the retrieval result page 36 is 
clicked by the browsing person, if a keyword related 



page in the customer site 61 is browsed, reference 
information which is URL of the retrieval result 
page containing the retrieval keyword is related to 
a request which is URL of the keyword related page in 
the accessed customer site 61 and recorded in the Web 
access log of the customer site 61. 

Because the retrieval keyword analyzing system has 
the same configuration as that of FIG. 2, main portions 
of this embodiment will be described with reference to 
FIG. 2. 

The Web access log of the customer site 61 
contains reference information. 

In the retrieval keyword analyzing system, the 
operations of the access sequence extracting unit 13, 
the keyword extracting unit 14 and the satisfaction 
degree extracting unit 15 are different from those in 
the retrieval keyword analyzing system .9 of the first 
embodiment . 

The access sequence extracting unit 13 executes 
the same processing in application of access sequence 
identifier, determination of division of the access 
sequence and the like as the access sequence extracting 
unit 13 of the first embodiment. 

The access sequence extracting unit 13 determines 
whether or not reference information indicates an 
off-site retrieval system based on the reference 
information about each access. 



59 



FIG. 31 shows data in which the URL pattern 
expressing the off-site retrieval system is related to 
a query pattern for extracting the retrieval keyword. 

When the access sequence extracting unit 13 
determines whether or not some access is an access from 
the off-site retrieval system, it investigates whether 
or not the reference information of each access 
contains any URL pattern of the retrieval system. 

The access sequence extracting unit 13 creates 
access sequence data supplied with a reference flag to 
an access in which the reference information indicates 
the off-site retrieval system. 

FIG. 32 shows an example of access sequence data. 
Reference flag * 0" in FIG. 32 indicates that it is 
not an access from the off-site retrieval system. 

On the other hand, the reference flag m 1" 
indicates that it is an access from the off-site 
retrieval system . 

As described above, the reference flag is recorded 
so that an access condition after the retrieval is 
investigated and the satisfaction degree is calculated 
even if retrieval is carried out in an access sequence. 

The keyword extracting unit 14 searches for 
an access in which the reference information contains 
a URL pattern of the retrieval system based on 
pre-processed data generated by the log pre-processing 
unit 12. 
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The keyword extracting unit 14 extracts 
a retrieval keyword input by the browsing person in 
the off-site retrieval system from the reference 
information containing the URL pattern, based on a 
5 query pattern corresponding to the URL pattern in the 

retrieval system. 

FIG. 33 shows an example of keyword data generated 
by the keyword extracting unit 14. 

The satisfaction degree calculation unit 15 
10 calculates a satisfaction degree from access sequence 

data generated by the access sequence extracting unit 
13. 

As a method for calculating the satisfaction 
degree, for example, the rule explained in the first 

15 embodiment will be applied. That is, the satisfaction 

degree calculation unit 15, after extracting access 
sequence _ data generated by the access sequence., 
extracting unit 13, calculates an after-retrieval 
browsing time of each access of the Web page. 

20 The after-retrieval browsing time is calculated by 

obtaining a differential in time from an access (access 
having a flag * 1" in FIG. 32) having the reference 
information using the retrieval system up to a finally 
browsed access in accesses indicated by the same access 

25 sequence identifier. 

In an access sequence without an access having the 
retrieval system as the reference information, the 



after-retrieval browsing time is not recorded. 

The satisfaction degree calculation unit 15 
extracts data in which the after-retrieval browsing 
time is related to the satisfaction degree as shown in 
FIG, 11 and calculates the satisfaction degree of each 
access . 

Unless there is any record about the after- 
retrieval browsing time, the satisfaction degree is not 
recorded. 

The satisfaction degree calculation unit 15 
relates the access sequence identifier to the 
satisfaction degree for each access identifier and 
creates the same satisfaction degree data as in 
FIG. 12. 

According to this embodiment, even if the customer 
site 61 is not provided with any retrieval system, 
the satisfaction degree of the retrieval keyword, is 
calculated . 

Therefore, customer sites from which the retrieval 
keyword analyzing result is acquired is increased 
largely . 

Although this embodiment has been described about 
a case where the retrieval keyword input screen 35 
exists in the off-site retrieval system 34!, the 
retrieval keyword input screen may exist in the 
customer site 61. A case where the customer entrusts 
an application service provider (ASP) service engaged 
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in retrieval service with a system for retrieving in 
the customer site 61 is included in such a case. 

FIG. 34 is a block diagram showing an example in 
which a retrieval keyword input screen 96 in the 
customer site 61 is changed to a retrieval result page 
97 in the off-site retrieval system 34 x and further to 
a keyword related page 98 in the customer site 61. 

When a retrieval keyword is input to the retrieval 
keyword input screen 96 by a browsing person in 
FIG. 34, the retrieval result page 97 is created by 
the off-site retrieval system 34 x . The URL indicating 
the retrieval result page 97 may sometimes contain 
a retrieval keyword input to the retrieval keyword 
input screen 96 in the customer site 61. 

When a link of the retrieval result page 97 of 
the off-site retrieval system 34i is clicked by the 
browsing person, and the keyword related page 98 in 
the customer site 61 is browsed, reference information 
which is URL of the retrieval result page 97 containing 
the retrieval keyword is related to a request which is 
URL of the keyword related page 98 in the accessed 
customer site 61 and recorded in the Web access log of 
the customer site 61 . 
Sixth Embodiment 

In this embodiment, a modification of the 
retrieval keyword analyzing system according to the 
first embodiment will be described. 



In the first to fifth embodiments, extraction of 
an access sequence or calculation of a qualitative 
evaluation value and extraction of a retrieval keyword 
are executed in parallel to each other and those 
results are finally related to each other through the 
relating unit. 

Contrary to this, this embodiment executes 
extraction of the retrieval keyword and calculation of 
the qualitative evaluation value in series. 

Although this embodiment describes a case where 
retrieval within the site is analyzed, the present 
invention is applied to analysis on retrieval out of 
the site by combining this embodiment with the fifth 
embodiment . 

FIG, 35 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
system. _ 

A retrieval keyword analyzing system 42 reads out 
a retrieval keyword analyzing program 44 recorded in a 
recording medium 43 and executes it. 

When the retrieval keyword analyzing program 44 is 
read into the system 42 and executed, the log pre- 
processing unit 12, the access sequence extracting unit 
13, a keyword extracting unit 45 and an evaluation 
value calculation unit 46 are realized. 

Data created by the keyword extracting unit 45 
and the evaluation value calculation unit 46 are stored 
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sequence/keyword data. The qualitative evaluation rule 
utilizes the same rule as the first embodiment. 

That is, the evaluation value calculation unit 46 
reads the access sequence/keyword data to calculate the 
after-retrieval browsing time of each access sequence. 
The after-retrieval browsing time is calculated from a 
difference between a time of an access to the keyword 
related page and the newest access time in the access 
based on the same access sequence identifier. 

The evaluation value calculation unit 46 reads 
correspondence data between the after-retrieval 
browsing time and the satisfaction degree and 
calculates the satisfaction degree of each access 
sequence . 

FIG. 37 shows intermediate generation data at this 
stage . 

The evaluation value calculation unit 46 acquires 
the satisfaction degree and retrieval keyword of the 
access sequence. An access sequence whose retrieval 
keyword is not recorded is out of processing object. 

The evaluation value calculation unit 46 acquires 
an average of the satisfaction degree of each retrieval 
keyword and generates its relation data. 

The specific contents of the relation data are the 

same as FIG . 14 . 

The evaluation value calculation unit 46 may 
calculate the quantitative evaluation value, for 
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example, the need value. As a method for calculating 
the need value, the method described in the second 
embodiment is applied. If the qualitative evaluation 
value and quantitative evaluation value are calculated 
5 with the evaluation value calculation unit 46, a graph 

based on the relation data may be displayed by the 
graphing unit 27 in the same manner as in the third 
embodiment . 

In the above-described respective embodiments, 
10 the respective processings about extraction of the 

access sequence, extraction of the retrieval keyword 
calculation of the qualitative evaluation value and 
calculation of the quantitative evaluation value are 
carried out not in parallel but in series and 
15 consequently, the same effect as the respective 

embodiments is obtained. This embodiment allows logs 
to be processed not by batch but for in each. access 
sequence . 

Although in each of the above-described 
20 embodiments, it is assumed that a single retrieval 

keyword is input for a single access sequence, even 
if the retrieval keyword is input multiple times for 
a single access sequence, the qualitative evaluation 
value and quantitative evaluation value of the 
25 retrieval keyword is acquired. 

For example, if the retrieval keyword is input to 
a single access sequence multiple times, it may be 
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possible to extract multiple access sequences with that 
access sequence as a boundary of retrieval keyword 
input and obtain the qualitative evaluation value and 
quantitative evaluation value using the extracted 
5 access sequence. 

In this case, the processing method of the above- 
described respective embodiments in which the retrieval 
keyword is input to a single access sequence once is 
applied to an access sequence after the division. 
10 Seventh Embodiment 

According to this embodiment, a retrieval keyword 
analyzing system for analyzing the trend that a Web 
site of analyzing object is browsed from outside 
contents existing in another Web site which is not an 
15 analyzing object by executing Web access log analysis 

of the analyzing object Web site will be described. 

According to this embodiment, the outside contents., 
include a retrieval system and the trend of browsing is 
investigated based on a retrieval keyword input to the 
20 retrieval system. 

FIG. 38 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
system. 

A retrieval keyword analyzing system 47 reads 
25 a retrieval keyword analyzing program 49 recorded in 

a recording medium 48 and executes it so as to realize 
a log pre-processing unit 12a, an access sequence 
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extracting unit 13a, a keyword extracting unit 14a, 
an evaluation value calculation unit 39a, a category 
forming unit 52, a trend analyzing unit 53 and an 
output processing unit 54. The retrieval keyword 
5 analyzing system 47 includes an output unit 55 and 

storage devices 38, and 58 to 60. 

The log pre-processing unit 12a, the access 
sequence extracting unit 13a, the keyword extracting 
unit 14a, the evaluation value calculation unit 39a, 

10 the category forming unit 52, the trend analyzing unit 

53 and the output processing unit 54 may be realized 
with hardware. 

Providing and acceptance of data may be carried 
out among respective units 12a to 14a, 39a, and 52 to 

15 54 through recording/reading the data to/from the 

storage device 38. 

As the storage devices 38, and 58 to 60, for . 
example, an internal memory and hard disc are 
available. The respective storage devices 38, and 58 

20 to 60 are elements which constitute a data base and 

each item of data may be controlled by the data base. 
The respective storage devices 38, and 58 to 60 is 
combined freely. 

The Web access log 7 stored in the storage device 

25 4 contains access destination identification data 

indicating a unit accessed by a browsing person, time 
data (for example, date and time) indicating an access 
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time and data related to a retrieval keyword when the 
browsing person makes access based on a retrieval 
result by the retrieval system. 

The log pre-processing unit 12a, the access 
5 sequence extracting unit 13a, the keyword extracting 

unit 14a and the evaluation value calculation unit 39a 
execute the same processing as the log pre-processing 
unit 12, the access sequence extracting unit 13, the 
keyword extracting unit 14 and the evaluation value 

10 calculation unit 39. However, this embodiment is 

different in that data of every predetermined time 
period is executed based on time log of the Web access 
log 7 and for each predetermined time period, relation 
data which makes correspondence between each retrieval 

15 keyword input to access an analyzing object Web site 

and the satisfaction degree which is a qualitative 
evaluation value and the need value which is a . 
quantitative evaluation value for each predetermined 
time period. 

20 Execution of processing of acquiring relation data 

in every predetermined time period with the respective 
units 12a to 14a, and 39a is not enabled until for 
example, the log pre-processing unit 12a accepts data 
of every predetermined time period in the Web access 

25 log 7. 

The evaluation value calculation unit 39a acquires 
the satisfaction degree and the need value of each 



retrieval keyword input to access an analyzing object 
Web site every predetermined time period and provides 
it to the category forming unit 52 and the trend 
forming unit 53. For example, if multiple qualitative 
evaluation values or quantitative evaluation values of 
the same retrieval keyword are calculated in the same 
time period, the evaluation value calculation unit 39a 
may acquire an average of the qualitative evaluation 
values or the quantitative evaluation values of the 
same retrieval keyword about that time period. 

The category forming unit 52 acquires, based on 
category data 72 stored in the storage device 58 and 
the satisfaction degree and the need value of each 
retrieval keyword in every predetermined time period, 
the satisfaction degree and need value of each categor 
to which each retrieval keyword belongs and provides 
the acquired satisfaction degree and need value of eac 
category to the trend analyzing unit 53. 

The category data 72 is, for example, data in 
which the retrieval keyword is related to the category 
to which the retrieval keyword belongs. 

The category forming unit 52 acquires, for 
example, a total sum or an average of the need values 
of the retrieval keyword belonging to the category in 
every time period to adopt the need value of the 
category of every time period. 

The category forming unit 52 obtains, for example 



a value by dividing the total sum of weighted 
satisfaction degree that each retrieval keyword 
belonging to the category is weighted by the need value 
by a total sum of the need values of respective 
retrieval keywords belonging to the category in every 
time period and adopts it as the satisfaction degree of 
the category of every time period. 

The trend analyzing unit 53 acquires trend data 73 
indicating transitions of need value and satisfaction 
degree of each retrieval keyword and each category and 
stores in the storage device 59. 

The trend analyzing unit 53 has a region 
calculation unit 53a, a region determining unit 53b and 
a message adding unit 53c. 

The region calculation unit 53a determines in 
every time period at which region determined by a need 
boundary value 7 4 and a satisfaction degree boundary 
value 75 the retrieval keyword and category are located 
based on the need boundary value 74 and the satisfac- 
tion degree boundary value 75 which are stored in the 
storage device 60, the satisfaction degree and need 
value of every time period obtained by the evaluation 
value calculation unit 39a and the satisfaction degree 
and need value of every time period obtained by the 
category forming unit 52. 

The need boundary value 74 and the satisfaction 
degree boundary value 75 are values indicating the 



boundary in which the meaning of each of the need value 
and satisfaction degree is switched. The need boundary 
value 74 and the satisfaction degree boundary value 75 
determine the regions in which a retrieval keyword and 
a category input to access an analyzing object Web site 
are located. 

The region determining unit 53b determines whether 
the retrieval keyword is moved in the region or whether 
the category is moved in the region with the lapse of 
the time period . 

The message adding unit 53c adds a message 
(for example, comment statement, note and the like) 
corresponding to a region to the retrieval keyword or 
the category which is moved in the region with the 
lapse of the time period based on message data 76 
stored in the storage device 60. 

The message data 7 6 comprises data which relates 
the regions before and after the retrieval keyword is 
moved, the retrieval keyword being input to access 
an analyzing object Web site with the message. 
The message data 76 is sufficient to be defined with 
a rule for adding a message meaning that if the region 
changes, the retrieval keyword is moved to the region 
after a lapse of time period. 

The trend analyzing unit 53 stores the trend data 
73 including the need value and satisfaction degree of 
the retrieval keyword and category of each time period, 



regions in which the retrieval keyword and category of 
each time period are located, a result of determination 
about whether or not the region changes, a message 
added to the retrieval keyword moved across the region 
and a message added to the category moved across the 
region. 

The output processing unit 54 executes processing 
for outputting the trend data 73 stored in the storage 
device 59 through the output unit 55. The output 
processing unit 54 outputs the trend data 73 in the 
form of for example, a table, graph, various kinds of 
diagrams or the like. 

FIG. 39 is a flow chart showing an example of the 
operation of the retrieval keyword analyzing system 47. 

In step VI, the log pre-processing unit 12a, the 
access sequence extracting unit 13a, the keyword 
extracting unit 14a, and the evaluation value 
calculation unit 39a create relation data which relates 
each retrieval keyword input to access an analyzing 
object Web site to its satisfaction degree and its need 
value at every predetermined time period based on time 
data of the Web access log 7. 

In step V2, the category forming unit 52 acquires 
the need value and satisfaction degree of a category 
which each retrieval keyword belongs to at every time 
period . 

In step V3, the region calculation unit 53a of the 
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trend analyzing unit 53 acquires a region in which the 
retrieval keyword and category are located at every 
time period based on the need value 74 and the 
satisfaction degree 75, and the need value and 
5 satisfaction degree of the retrieval keyword and 

category and the region in which the retrieval keyword 
and category are located, are included in the trend 
data 73 . 

In step V4, the region determining unit 53b of the 

10 trend analyzing unit 53 determines whether the region 

in which the retrieval keyword is located is changed or 
the region in which the category is located is changed 
with the lapse of the time period. Its judgment result 
is included in the trend data 73. 

15 When it is determined that the region in which 

the retrieval keyword or the category is located is 
changed, in step V5, the message adding unit 53c of the 
trend analyzing unit 53 adds a message corresponding to 
a conversion of the region to the retrieval keyword 

20 whose region is changed or the category whose region is 

changed based on the message data 76, and its result is 
included in the trend data 73. 

In step V6, the output processing unit 54 displays 
a transition of the need value and satisfaction degree 

25 of the retrieval keyword and category and a message 

based on the trend data 73 corresponding to an 
operation of an analyzer. 
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Hereinafter, relation data obtained by the 
evaluation value calculation unit 39a will be 
described. 

The evaluation value calculation unit 39a provides 
5 the relation data indicating a result of calculation on 

the need value and satisfaction degree of a retrieval 
keyword input to access an analyzing object Web site as 
shown in FIG. 40 to the region calculation unit 53a and 
the category forming unit 52 of the trend analyzing 

10 unit 53 at every time period. 

The category forming unit 52 obtains the need 
value and satisfaction degree of each category from the 
need value and satisfaction degree of each retrieval 
keyword based on the category data 72 and the need 

15 value and satisfaction degree of the retrieval keyword 

as shown in FIG . 41 at every time period and provides 
the need value and satisfaction degree of the category 
to the region calculation unit 53a of the trend 
analyzing unit 53. 

20 Data in which a message is added to the transition 

of the retrieval keyword as shown in FIG. 42 and data 
in which a message is added to the transition of the 
category as shown in FIG. 43 are included in the trend 
data 73 by the trend analyzing unit 53, and the trend 

25 data 73 is stored in the storage device 59. 

Hereinafter, the category forming unit 52 will be 
described in detail. 
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FIG. 44 is a flow chart showing an example of the 
operation of the category forming unit 52. 

In step Wl, the category forming unit 52 
identifies a retrieval keyword belonging to a category 
5 based on the category data 72 at every time period. 

In step W2, the category forming unit 52 acquires 
a total sum of the need values of each retrieval 
keyword belonging to the category as indicated by 
Equation 1 and adopts it as the need value of the 
10 category at every time period. 

Need value of category 
= Z (need value of i-th retrieval keyword of category) 

(1) 

In step W3, the category forming unit 52 obtains 
15 weighted average of the satisfaction degree of each 

retrieval keyword belonging to the category as 
indicated by Equation 2 and adopts it as the . 
satisfaction degree of the category at every time 
period. 

20 Satisfaction degree of category 

= X { (need value of i-th retrieval keyword of category) 

x (satisfaction degree of i-th retrieval keyword of 
category) ) 

/ E(need value of i-th retrieval keyword of category) 
25 (2) 

According to Equation 2, the satisfaction degree 
of the category is obtained by dividing the total sum 
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of product between the satisfaction degree and need 
value of each retrieval keyword belonging to the 
category by the total sum of the need values of the 
retrieval keyword belonging to the category. 
5 In step W4, the category forming unit 52 

determines whether or not the need value and 
satisfaction degree have been acquired for all the 
categories at every time period and if the need values 
and satisfaction degrees of all the categories are not 
10 obtained, a processing in and after step Wl is 

repeated. 

Hereinafter, there will be described the reason 
why the satisfaction degree of the category is obtained 
by dividing the total sum of the satisfaction degree 
15 of each retrieval keyword belonging to the category 

weighted by each need value by the total sum of the 
need value of each retrieval keyword belonging. to the 
category. 

For example, assume that in a category C, although 
20 the need value of a retrieval keyword is extremely 

small, the satisfaction degree of the retrieval keyword 
C]_ is extremely large. In this case, it is determined 
that although the number of browsing persons accessing 
an analyzing object Web site using the retrieval 
25 keyword Ci is extremely small, only a few browsing 

persons are satisfied. 

On the other hand, assume that in the same 
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category C, although the need value of a retrieval 
keyword C2 is extremely large, the satisfaction degree 
of the retrieval keyword C2 is extremely small. 
In this case, it is determined that although the number 
5 of browsing persons accessing the analyzing object Web 

site using the retrieval keyword C2 is extremely large, 
many browsing persons are not satisfied. 

In such a case, assuming that the satisfaction 
degree of the category C is an average of the 

10 satisfaction degrees of the retrieval keywords C]_, C2 

belonging to the category C, the satisfaction degree of 
the retrieval keyword Cj_ having a few browsing persons 
and the satisfaction degree of the retrieval keyword C2 
having many browsing persons are handled on the same 

15 level. Therefore, although there are many browsing 

persons who are not satisfied, it is determined that 
the category has an intermediate satisfaction degree. 

However, the satisfaction degree of the category C 
should be more affected by the satisfaction degree of 

20 the retrieval keyword C2 having many browsing persons 

than the satisfaction degree of the retrieval keyword 
Ci having a few browsing persons. 

Then, the satisfaction degrees of the respective 
retrieval keywords C\, C2 belonging to the category C 

25 are weighted with the need value and the total sum of 

them is obtained. 

To evaluate the satisfaction degrees of the 



category C and other categories with an equal standard 
regardless of the number of browsing persons, the total 
sum of the weighted satisfaction degrees in the 
category C is divided by the number of all browsing 
persons in the category C or the need value of the 
retrieval keyword belonging to the category C. 

FIG. 45 is a diagram showing an example of the 
data conversion result by the category forming unit 52. 

The category forming unit 52 accepts category data 
72 which relates the retrieval keyword to a category to 
which the retrieval keyword belongs and relation data 
77 indicating the need value and the satisfaction 
degree of the retrieval keyword at every time period. 

The category forming unit 52 acquires categorize 
data 78 including the need value and satisfaction 
degree of the category at every time period. In an 
example of FIG. 45, five kinds of the retrieval 
keywords are summarized into two kinds of categories. 
Each category undergoes the same analysis as the 
analysis on individual retrieval keywords. 

Hereinafter, the trend analyzing unit 53 will be 
described in detail. 

FIG. 46 is a flow chart showing an example of the 
operation of the trend analyzing unit 53. 

In step XI, the region calculation unit 53a of the 
trend analyzing unit 53 acquires a region in which all 
retrieval keywords and categories are located of each 



time period, based on the need value and satisfaction 
degree of each of all the retrieval keywords and 
categories of each time period and the need boundary 
value 7 4 and the satisfaction boundary value 75. 
The region calculation unit 53a incorporates the need 
value and the satisfaction degree of the retrieval 
keyword and category and region of the retrieval 
keyword and category in the trend data 73. 

In step X2, the region determining unit 53b of the 
trend analyzing unit 53 determines whether or not the 
region of the retrieval keyword and category changes by 
comparing the regions in which the retrieval keyword 
and the category are located before and after the time 
period, acquires a retrieval keyword or category whose 
region is changed and incorporate its result in the 
trend data 73. 

When the region in which the retrieval keyword or 
the category is located is changed, in step X3, the 
message adding unit 53c of the trend analyzing unit 53 
relates messages corresponding to regions before and 
after the lapse of the time period with the retrieval 
keyword or category whose region is changed based on 
the message data 76 and incorporate those messages in 
the trend data 73. 

FIG. 47 is a diagram showing an example of 
designations of regions determined by the need boundary 
value 74 and the satisfaction degree boundary value 75. 
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The need boundary value 74 is set up for the need 
value while the satisfaction degree boundary value 75 
is set up for the satisfaction degree. A plane is 
divided to four sections and those four sections are 
5 supplied with designations. 

Both the need boundary value 74 and the 
satisfaction degree boundary value 75 are set to 100. 
A region in which the need value and the satisfaction 
degree are small is designated * failure region. " 
10 A region in which the need value is small while the 

satisfaction degree is large is designated "hidden 
success region." A region in which the need value 
is large while the satisfaction degree is small is 
designated "chance loss region." A region in which 
15 the need value and the satisfaction degree are large is 

designated "success region." 

FIG. 48 is a diagram showing an example of the 
trend data 73 created by the trend analyzing unit 53. 

For example, a retrieval keyword or category whose 
20 region is changed before and after switching of the 

time period is supplied with a message meaning that it 
is moved to its destination region. As for the trend 
data 73, retrieval keywords "Buffet style" and "Lunch," 
whose region is changed, are supplied with messages 
25 "transition to success region" and "transition to 

failure region" each. 

As for supplying with the message, the message 



data 76 in which a region after the lapse of the time 
period is related to its corresponding region is 
prepared and a retrieval keyword or category whose 
region is changed with the lapse of the time period is 
detected by the region determining unit 53b of the 
trend analyzing unit 53. Further, it is possible to 
supply a retrieval keyword or category whose region is 
changed with a message corresponding to a region in 
which it is scheduled to be located after the lapse 
of the time period by means of the message adding unit 
53c of the trend analyzing unit 53 base on the massage 
data 76. 

FIG. 49 is a diagram showing another example of 
a message to be added when the region is moved. 

A retrieval keyword or category which is changed 
across its boundary when the time period elapses is 
supplied with a message indicating in which direction 
it crosses the boundary. For example, a retrieval 
keyword or category which is moved from "hidden success 
region" to "success region" is supplied with a message 
"need rise." The same thing is said about other cases. 

As for the supplying with the message, the message 
data 76 which relates a region before the time period 
elapses, a region after the time period elapses and a 
message is prepared and a retrieval keyword or category 
whose region is changed when the time period elapses is 
detected by means of the region determining unit 53b of 



the trend analyzing unit 53. Further, a message which 
relates a region of a retrieval keyword or category 
whose region is changed before the time period elapses 
to a region in which it is scheduled to be located 
after the time period elapses is acquired by the 
message adding unit 53 of the trend analyzing unit 53 
based on the message data 76. 

Hereinafter, the output processing unit 54 will be 

described in detail. 

The output processing unit 54 displays a graph 

indicated by FIG. 50, for example. 

The graph has coordinates indicating the need 
value and the satisfaction degree and indicates the 
need boundary value and satisfaction degree boundary 
value. Respective regions are supplied with 
designations and an index expressing a retrieval 
. keyword or category of each time period is plotted 
based on the need value and satisfaction degree and the 
plotted indexes are connected with a line. FIG. 50 
shows a trajectory indicating a transition each time 
when the time period elapses with an arrow. 

Additionally, the output processing unit 54 
displays a graph of the retrieval keyword or category 
at each time period based on the need value and 
satisfaction degree as shown in FIGS. 42 and 43, 
categorize data 78 at each time period as shown in 
FIG. 45 and trend data 73 of table type expressing 
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a transition of the retrieval keyword and its message 
as shown in FIG. 4 8 on the output unit 55. 

According to this embodiment, the analyzer 
acquires customer collection strategy of an analyzing 
5 object Web site and a policy for improvement of the 

content . 

For example, the analyzer acquirers following 
effects . 

First, the analyzer searches for a retrieval 
10 keyword and category which relate to a large number of 

browsing persons but in which the browsing persons 
terminate browsing of an analyzing object Web site 
soon. Therefore, the analyzer determines whether or 
not the analyzing object Web site retrieved based on 
15 the retrieval keyword and the category satisfies a 

browsing person request. The analyzer detects and 
investigates a kind of chance loss state which cannot 
satisfy a request of the browsing person. Thus, the 
analyzer improves the quality of the analyzing object 
20 Web site by improving the chance loss in the analyzing 

object Web site. 

Second, the analyzer determines whether or not 
there exists an excellent retrieval keyword and 
category which increases the number of browsing persons 
25 who accesses the analyzing object Web site and 

satisfies the browsing person who makes access. 
Further, the analyzer determines whether or not the 
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excellent condition of the retrieval keyword and 
category is temporary or declining and additionally 
determines whether or not a new retrieval keyword and 
category should be considered. 
5 Third, the analyzer executes static or dynamic 

analysis not only in the unit of individual retrieval 
keyword but also in the unit of category to which each 
retrieval keyword belongs. Therefore, the analyzer 
acquires an analysis result corresponding to the 
10 contents which the analyzer wants to consider and the 

matter which the analyzer wants to consider, and grasp 
a viewing trend of the analyzing object Web site 
appropriately and easily so as to improve the accuracy 
of analysis . 

15 Fourth, the analyzer acquires a change with the 

lapse of time of an analysis result on the retrieval 
keyword and category through a graph and grasps a 
change with the lapse of time period of viewing trend 
easily thereby making his analyzing work effective. 

20 Fifth, the analyzer acquires effective data from 

a large volume of data quickly using a result of trend 
analysis on the retrieval keyword and category, so as 
to improve the accuracy of analysis and reduce labor 
necessary for the analysis. 

25 Sixth, the analyzer searches for browsing person' s 

trend easily at a high precision instead of a simple 
collection by a conventional Web access log. 
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Seventh, the analyzer grasps the trend of an 
entire category which is not grasped even when the 
retrieval keyword is analyzed individually. 

Eighth, the analyzer acquires an analysis result 
5 about the retrieval keyword input according to various 

styles under a browsing person's intention easily and 
appropriately along an intention of the analyzer. 
Hereinafter, the eighth effect will be described with 
reference to its specific example. 

10 Because the retrieval keyword is input according 

to various styles under an intention of a browsing 
person, even if the retrieval keyword is analyzed based 
on the Web access log analysis, the analyzer may not be 
able to acquire an analysis result along his intention. 

15 For example, assume that the analyzer wants to 

investigate how the analyzing object Web site is 
. accessed, currently after a retrieval keyword concerning 
cooking is input. In this case, the conventional Web 
access log analysis acquires the number of browsing 

20 persons concerning the retrieval keyword * cooking" 

as an analysis result, however does not include the 
numbers of browsing persons about other retrieval 
keywords concerning cooking, for example, * gourmet" and 
""fast food" in the analysis result. 

25 However, by analyzing in the unit of category as 

mentioned in this embodiment, the analyzer acquires an 
analysis result which the analyzer wants appropriately. 
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Eighth Embodiment 

In this embodiment, a modification of the seventh 
embodiment will be described. Its retrieval keyword 
analyzing system is different from the seventh 
5 embodiment mainly in the trend analyzing unit and the 

other units are the same. 

The trend analyzing unit acquires a moving 
distance and direction of the retrieval keyword and 
category when the time period elapses on a plane in 
10 which the need value and satisfaction degree are set up 

as coordinates, without using the need boundary value 
and satisfaction degree boundary value. 

FIG. 51 is a block diagram showing an example of 
the configuration of the trend analyzing unit 79. 
15 The trend analyzing unit 7 9 adopts the need value 

and satisfaction degree of the retrieval keyword and 
category of each time period as coordinate, values and 
acquires a moving distance of each of all the retrieval 
keywords and categories located before and after the 
20 time period and supplies a retrieval keyword and 

category having a large moving distance with a message 
corresponding to its moving direction. 

The trend analyzing unit 79 contains a moving 
distance calculation unit 79a, a moving distance 
25 determining unit 79b, a moving direction calculation 

unit 7 9c and a message adding unit 7 9d. The trend 
analyzing unit 7 9 includes the same function as the 
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trend analyzing unit 53 described in the seventh 
embodiment . 

The moving distance calculation unit 79a acquires 
a moving distance of each of all the retrieval keywords 
5 and categories located before and after the time period 

based on the retrieval keyword of each time period 
acquired by the evaluation value calculation unit 39a, 
and the need value and satisfaction degree of a 
category of each time period acquired by the category 
10 forming unit 52 according to Equation 3, provides its 

result to the moving distance determining unit 79b and 
incorporates it in the trend data 81. 

Moving distance 

^j{ (succeeding need value) - (previous need value) }2 
+ { (succeeding satisfaction degree) - (previous satisfaction degree) }2 

(3) 

The moving distance determining unit 7 9b 
determines whether or not the retrieval keyword or 
category of each time period moves beyond a moving 
distance threshold 80 stored in the storage device 60 
and incorporates its result in the trend data 81. 

FIG. 52 shows the relation between a specific 
example of the moving distance threshold and an 
operation of the trend analyzing unit 79. In the 
example of FIG. 52, the moving distance threshold is 
set to 120 and thus, if a moving distance is 120 or 
more, calculation of the moving direction and supplying 
of a message are executed. 
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The moving direction calculation unit 79c 
calculates a moving direction with the lapse of a time 
period according to Equation 4 based on the need value 
and satisfaction degree of a retrieval keyword or 
category whose moving distance exceeds a moving 
distance threshold, provides its result to the message 
adding unit 79d and incorporates it in the trend 
data 81. 

Moving direction 

t (succeeding satisfaction degree) - (previous satisfaction degree) 

- tan 1 

(succeeding need value) - (previous need value) 



(4) 

The message adding unit 79d supplies a retrieval 
keyword or category which exceeds its moving distance 
threshold based on the message data 82 stored in the 
15 storage device 60 corresponding to its moving 

direction . 

FIG. 53 shows an example of the message data 82. 
An angle indicating the moving distance has a 
correspondence with a message meaning a rise and fall 

20 of the need and satisfaction. 

FIG. 54 shows a specific example of the relation 
between a message and a moving direction. In FIG. 54, 
if the moving direction is 0° or more to less than 30°, 
it is defined to display a message "need rises/' if the 

25 moving direction is 30° or more to less than 60°, it is 

defined that a message "both need and satisfaction 
degree rise" is displayed, and if the moving direction 
is 60° or more to less than 90°, it is defined that 
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a message * satisfaction degree rises" is displayed. 

Not only a message when the moving direction is 0° 
or more to less than 90° in which both the need value 
and satisfaction degree increase, but also a message 
when the moving direction is 90° or more to less than 
360° in which at least one of the need value and 
satisfaction degree decreases is defined. 

FIG. 55 is a diagram showing an example of the 
trend data 81 created by the trend analyzing unit 79. 

Retrieval keywords ^Buffet style," *Lunch" whose 
moving distance is large are supplied with a message 
corresponding to the moving direction. 

FIG. 56 is a flow chart showing an example of the 
operation of the retrieval keyword analyzing system. 

Because steps Yl and Y2 are the same as steps VI 
and V2 shown in FIG. 39, description thereof is 
omitted. 

In step Y3, the moving distance calculation unit 
79a of the trend analyzing unit 79 acquires a moving 
distance of the retrieval keyword and category with the 
lapse of a time period, incorporates its result in the 
trend data 81 and provides it to the moving distance 
determining unit 79b. 

In step Y4, the moving distance determining unit 
79b of the trend analyzing unit 79 determines whether 
or not the retrieval keyword and category exceeds the 
moving distance threshold 80 with the lapse of the time 



period, based on the moving distance threshold 80 
stored in the storage device 60, incorporates its 
result in the trend data 81 and provides it to the 
moving direction calculation unit 79c. 

In step Y5, the moving direction calculation unit 
79c of the trend analyzing unit 79 calculates the 
moving direction of the retrieval keyword or category 
whose moving distance is determined to exceed the 
moving distance threshold, incorporates its result in 
the trend data 81 and provides it to the message adding 
unit 79d. 

In step Y6, the message adding unit 79d of the 
trend analyzing unit 79 adds a retrieval keyword or 
category whose moving direction is calculated with a 
message corresponding to the moving direction, based on 
the message data 82 stored in the storage device 60 and 
incorporates its result in the trend data 81.. 

In step Y7, the output processing unit 54 displays 
a transition of the need value and satisfaction degree 
of the retrieval keyword or category and a message 
based on the trend data 81 corresponding to an 
operation of the analyzer. 

FIG. 57 is a diagram showing an example of the 
trend data 81 output by the output processing unit 54. 

FIG. 57 shows the trend data 81 obtained as a 
result of the trend analysis over three time periods. 
The output processing unit 54 displays trend data 81 
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created by the trend analyzing unit 79 every continuous 
two time periods on the same plane. FIG. 57 shows a 
combination of the trend data 73 described in the first 
embodiment and the trend data 81 described in this 
5 embodiment . 

A graph shown in FIG. 57 has coordinates 
indicating the need value and satisfaction degree and 
displays the need boundary value and satisfaction 
degree boundary value. Respective regions are supplied 

10 with region designations. An index indicating a 

retrieval keyword ""party" of each time period is 
plotted according to its need value and satisfaction 
degree and plotted indexes are connected with lines. 
FIG. 57 indicates a trajectory indicating a transition 

15 each time when the time period elapses with arrows. 

In FIG. 57, any change, namely, a case where the region 
boundary is crossed or a case where the moving distance 
is large, is provided with a corresponding message. 

According to this embodiment, a retrieval keyword 

20 input to access an analyzing object Web site is 

analyzed each time when the time period elapses and it 
is possible to provide its change amount as a moving 
distance and its change content as a moving direction 
to the analyzer. 

25 According to the seventh embodiment and this 

embodiment, a case of analyzing a retrieval keyword to 
be input to access an analyzing object Web site is 
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described. 

However, the seventh embodiment and this 
embodiment may be applied to analysis on a reference 
Web site or domain having outside contents which are 
accessed before accessing an analyzing object Web site. 

Additionally, it is possible to analyze a campaign 
mail in case where the analyzing object Web site is 
accessed based on the campaign mail and acquire an 
analysis result on ID indicating the type of the 
campaign. 

Consequently, the analyzer analyzes the need level 
and satisfaction level about the retrieval keyword, 
reference Web site and campaign to grasp, for example, 
a result by expressing spatially. 

In the seventh embodiment and this embodiment, the 
processing up to acquiring relation data of each time 
period may be exchanged with the above-described other 
processing. That is, by executing the above-described 
various methods of the respective embodiments for a 
predetermined time period as a processing for acquiring 
the relation data of each predetermined time period, 
the same effect is obtained. 

Although according to the seventh embodiment and 
this embodiment, the need value and satisfaction degree 
of the category are acquired according to Equations 1 
and 2, it is possible to acquire the need value and 
satisfaction degree according to another method using 
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another definition . 

Although according to this embodiment, the moving 
distance and moving direction of the retrieval keyword 
and category are acquired according to Equations 3 and 
4, it is possible to acquire the moving distance and 
moving direction of the retrieval keyword and category 
according to another method using another definition. 

According to the seventh embodiment and this 
embodiment, the analyzing object may be no Web site in 
terms of analysis unit and may be a Web page or a Web 
page group comprising multiple Web pages. 

Although according to this embodiment, the moving 
direction is calculated only for a retrieval keyword or 
category whose moving distance exceeds its moving 
distance threshold, the moving distance and moving 
direction may be calculated for all retrieval keywords 
or categories or the moving distance and moving . 
direction may be calculated for retrieval keywords or 
categories which satisfy another condition. 

According to the seventh embodiment and this 
embodiment, as an analysis viewpoint about a viewing 
trend of the analysis object, the need value, which 
indicates an expectancy to the analyzing object Web 
site by the browsing person and the satisfaction 
degree, indicating the level of satisfaction which the 
analyzing object Web site gives to the browsing person 
are employed. However, the analysis viewpoint about 
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the viewing trend is changed freely. For example, the 
number of chances in which the object of the analyzing 
object Web site is achieved and the degree of 
achievement expressing the quantity of object 
achievements may be adopted as the analysis viewpoint. 
For example, it is possible to regard the number of 
browsing persons in a Web site which aims at receiving 
orders as the number of chances for achieving an object 
and the quantity of received orders as the level of 
achievement and adopt the number of chances and the 
level of achievement as the analysis viewpoint. 
Ninth Embodiment 

According to this embodiment, a modification of 
the retrieval keyword analyzing system according to the 
first to eighth embodiments will be described. 

According to the first to eighth embodiments, 
a case where a single retrieval keyword is input into 
an extracted access sequence is described. 

The relation about an access sequence in which 
a single retrieval keyword is input to an extracted 
access sequence, the retrieval result page 2, the 
customer site 61, an access sequence in the customer 
site 61 and after-retrieval browsing time will be 
described with reference to FIGS. 58 to 60. 

FIG. 58 is a diagram showing an example of an 
access sequence where a retrieval system is provided 
within the customer site 61. Such a case can be 
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processed in the first to fourth embodiments and the 
sixth to eighth embodiments. 

The browsing person browses Web page Pal, Pa2, 
retrieval result page SPa, Web pages Pa3 to Pa5 in 
5 succession and finally Web page Pa6. The Web page Pa2, 

retrieval result page SPa, Web pages Pa3 to Pa5 belong 
to the customer site 61. The Web page Pa2 is a screen 
which allows a retrieval keyword to be input. 

An access sequence within the customer site 61 is 

10 Pa2 -> SPa — > Pa3 — > Pa4 Pa5. Because according to 

the definition of the first embodiment, the after- 
retrieval browsing time is a time interval obtained by 
subtracting an access time to a first keyword related 
page (that is, a page next to the retrieval result page 

15 SPa) from a last access time in an access sequence 

(that is, an access sequence in the customer site 61), 
this is equal to an interval of access time from the 
Web page Pa3 to the Web page Pa5. 

FIG. 59 is a diagram showing an access sequence 

20 in case where a retrieval system exists outside the 

customer site 61. Such a case can be processed in the 
fifth embodiment. 

The browsing person browses the Web page Pbl, the 
retrieval result page SPb, and the Web pages Pb2 to Pb6 

25 successively and finally the Web page Pb7 . The Web 

pages Pb2 to Pb6 are Web pages belonging to the 
customer site 61. When the browsing person inputs a 
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retrieval keyword into the screen Pbl which allows the 
retrieval keyword to be input in an off-site retrieval 
system 34^, the retrieval result page SPb is created. 
The retrieval result page SPb includes a link to the 
Web page Pb2 of the customer site 61. 

The access sequence in the customer site 61 is Pb2 
— » Pb3 — > Pb4 -> Pb5 — » Pb6. Because according to the 
definition of the fifth embodiment, the after-retrieval 
browsing time is a difference in time from an access 
having reference information using the retrieval system 
in an access represented by the same access sequence 
identifier to a last browsed access, it is an interval 
in access time from the Web page Pb2 to the Web 
page Pb6. 

FIG. 60 is a diagram showing an example of an 
access sequence where the retrieval system exists 
outside the customer site 61 while a retrieval result 
page exists halfway of an access sequence within the 
customer site 61. Such a case can be processed in the 
fifth embodiment. 

The browsing person browses the Web pages Pel to 
Pc3, the retrieval result page SPc, and the Web pages 
Pc4 to Pc6 successively and finally browses the Web 
page Pc7, The Web pages Pc2 to Pc6 are Web pages 
belonging to the customer site 61. The Web page Pc3 
is a screen which allows a retrieval keyword to be 
input and corresponding to a result of its input, the 



off-site retrieval system 34^ outputs the retrieval 
result page SPc. 

The access sequence within the customer site 61 is 
Pc2 — » Pc3 — > Pc4 -> Pc5 — > Pc6. Because according to 
the definition of the fifth embodiment, the after- 
retrieval browsing time is a difference in time from an 
access having reference information using the retrieval 
system in an access represented by the same access 
sequence identifier to a last browsed access, it is 
an interval in access time from the Web page Pb4 to the 
Web page Pb6. 

In the first to third, and fifth to eighth 
embodiments, as shown in FIGS* 58 to 60, the retrieval 
keyword is input once in an extracted access sequence 
and the after-retrieval browsing time, which is a 
browsing time from the retrieval result page up to the 
latter Web page is treated as the satisfaction degree. 

In the fourth embodiment, the retrieval keyword is 
input once in an extracted access sequence and a 
success degree to the retrieval result of this 
retrieval keyword is acquired. 

This embodiment improves the first to eighth 
embodiments. The retrieval keyword is input multiple 
times in an extracted access sequence. 

An example that an access sequence in the customer 
site of this embodiment is divided to further one 
or more access sequences (hereinafter referred to as 
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* sub-access sequence" ) will be described. Depending on 
a situation, there may exit no sub-access sequence in 
the access sequence within the customer site. 

The same processing method as the above-described 
5 respective embodiments is applied to the sub-access 

sequence . 

The sub-access sequence is defined by extracting 
a starting end determined by an access to a retrieval 
result page and with a terminal end of continuous 

10 accesses by the same access person as the extracted 

starting end, after the starting end. An example of 
the sub-access sequence extraction rule for extracting 
the sub-access sequence from the access sequence within 
the customer site will be described below. 

15 The starting end of the sub-access sequence is 

extracted according to the first rule if the retrieval 
system exists in the customer site and if it exists 
outside the customer site, according to the second 
rule . 

20 According to the first rule, if the retrieval 

system in the customer site outputs a retrieval result 
page in the extracted access sequence, the starting 
end of the sub-access sequence is an access to the 
retrieval result page output by the retrieval system in 

25 the customer site. 

According to the second rule, if the retrieval 
system outside the customer site outputs a retrieval 
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result page in an extracted access sequence and an 
access just following an access to the retrieval result 
page is an access to a Web page within the customer 
site, the starting end of the sub-access sequence is 
an access to a Web page within the customer site having 
a retrieval result page output by the retrieval system 
outside the customer site as reference information. 

That is, when retrieval is executed by a retrieval 
system outside the customer site, the starting end of 
a sub-access sequence is an access to a Web page within 
the customer site selected on a retrieval result page 
by a retrieval system outside the customer site. 

The access just following an access to the Web 
page *A" refers to an access made after the access to 
the Web page * A" in continuous accesses made by the 
same access person, and further an access nearest the 
access, to the Web page 'A" in terms of time.. Assuming 
that that Web page *A" is a retrieval result page SPb 
in FIG. 59, an access to a Web page Pb2 corresponds to 
the access made after the access to the Web page *A." 

The terminal end of the sub-access sequence is 
extracted according to a third rule. 

According to the third rule, the terminal end of 
the sub-access sequence is an access within the 
customer site just preceding the starting end of a next 
sub-access sequence. However, when there exists no 
starting end of a next sub-access sequence, the 
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terminal end of the access sequence within the customer 
site is regarded as the terminal end of the sub-access 
sequence . 

The access just preceding an access to the Web 
page * A" refers to an access made before the access to 
the Web page *A" in continuous accesses made by the 
same access person, and further an access nearest the 
access to the Web page * A" in terms of time. Further, 
the access within the customer site just preceding an 
access to the Web page *A" refers to an access made 
before the access to the Web page * A" in continuous 
accesses made by the same access person, and further an 
access within the customer site nearest the access to 
the Web page *A" in terms of time. Assuming that that 
Web page *A" is the Web page Pc4, the Web page Pc3 
corresponds to the access within the customer site just 
.preceding an access to the Web page *A." 

When an access to a retrieval result page output 
by a retrieval system within the customer site falls on 
an access to a Web page having a retrieval result page 
output by the retrieval system outside the customer 
site as reference information, the fourth rule is 
adopted to obtain the starting end of the sub-access 
sequence . 

According to the fourth rule, if an access to 
a retrieval result page output by a retrieval system 
within the customer site corresponds to an access to 
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a Web page having a retrieval result page output by a 
retrieval system outside the customer site as reference 
information,, an access to the retrieval result page 
output by the retrieval system within the customer site 
is the starting end of a sub-access sequence. 

The relation about an access sequence in case 
where multiple retrieval keywords are input to an 
access sequence, a retrieval result page, a customer 
site, an access sequence within the customer site and 
the sub-access sequence will be described with 
reference to FIGS, 61 to 63. 

FIG. 61 is a diagram showing an example in which 
multiple retrievals are carried out in an access 
sequence provided with a retrieval system within the 
customer site 61. FIG. 61 has a correspondence with 
FIG. 58 in which only a retrieval is performed by an 
on-site retrieval system within the customer site.. 

The browsing person browses the Web pages Pdl and 
Pd2, retrieval result page SPd, Web pages Pd3 to Pd5, 
retrieval result pages SPe, SPf, Web pages Pd6 and Pd7 
successively and finally browses the Web page Pd8 . 
The Web pages Pd2 to Pd7 and the retrieval result pages 
SPd to SPf are pages belonging to the customer site 61. 
The Web pages Pd2, Pd5 and the respective retrieval 
result pages SPd to SPf are screens which allow the 
retrieval keyword to be input. 

According to the sub-access sequence extraction 
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rule, SPd — > Pd3 -> Pd4 -> Pd5, from an access to the 
retrieval result page SPd up to an access to a page 
within the customer site just preceding an access to 
a next retrieval result page SPe (that is, access to 
the Web page Pd5) is a sub-access sequence 100. 

Likewise, from an access to the retrieval result 
page SPe up to an access to a page within the customer 
site 61 just preceding a next retrieval result page SPf 
(that is, access to the retrieval result page SPe) is 
a sub-access sequence 101. 

Likewise, SPf — » Pd6 -» Pd7 from an access to the 
retrieval result page SPf to an access to the terminal 
end of an access sequence within the customer site 61 
is a sub-access sequence 102. 

Like this example, some retrieval result page may 
allow a retrieval keyword to be input therein or the 
keyword related. page may be a retrieval result page... 
In these cases, a transition on the display screen is 
more or less different from that shown in FIG. 2. 

FIG. 62 is a diagram showing an example in which 
multiple retrievals are carried out in an access 
sequence in case where the retrieval system exists 
outside the customer site. FIG. 62 has a 
correspondence with FIG. 60 in which the retrieval is 
carried out once through the retrieval system 34^ 
outside the customer site 61. 

The browsing person accesses the Web pages Pel to 
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Pe4, the retrieval result page SPg, the Web pages Pe5 
to Pe7, the retrieval result page SPh, the Web pages 
Pe8 to PelO successively and finally browses the Web 
page Pell. The Web pages Pe2 to PelO are pages 
belonging to the customer site 61. The Web pages Pe4 
and Pe7 are screens which allows a retrieval keyword to 
be input therein and corresponding to a result of the 
input, the off-site retrieval system 34^ outputs 
retrieval result pages SPg and SPh. 

According to the sub-access sequence extraction 
rule, Pe5 Pe6 — » Pe7 from an access to a page having 
the retrieval result page SPg as reference information 
(that is, an access to the Web page Pe5) up to an 
access to a page within the customer site 61 (that is, 
an access to the Web page Pe8) just preceding an access 
to a page having a next retrieval result page as 
reference information (that is, an access to the Web 
page Pe7) serves as a first sub-access sequence. 

Likewise, Pe8 — > Pe9 — > PelO from an access to a 
page having the retrieval result page SPh as reference 
information (that is, an access to the Web page Pe8) up 
to an access to a terminal end of an access sequence 
within the customer site 61 (that is, an access to the 
Web page 10) serves as a second sub-access sequence. 

FIG. 63 is a diagram showing an example in which 
the retrieval is carried out halfway of an access 
sequence using both a retrieval system within the 
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customer site and a retrieval system outside the 
customer site. FIG. 63 has a correspondence with 
a combination of FIGS. 58 to 60. 

The browsing person browses the Web page Pfl, 
the retrieval result page SPi, the Web page Pf2, the 
retrieval result page SP j , the Web pages Pf3 to Pf5, 
the retrieval result page SPk, the retrieval result 
page SPI, the Web page Pf6, the retrieval result pages 
SPm, SPn, and the Web pages Pf7, Pf8 successively and 
finally browses the Web page Pf9. The Web pages Pf2 to 
Pf8, and the retrieval result pages SPj, and SPI to SPn 
are pages belonging to the customer site 61. The Web 
pages Pfl, Pf2, Pf5, Pf6 and the retrieval result pages 
SPi to SPn are screen which allow a retrieval keyword 
to be input therein. Corresponding to a result of 
input of the retrieval keyword in the Web page Pfl, 
the off-site retrieval system 34 x outputs a retrieval 
result page SPi and corresponding to an input in the 
Web page Pf5, the off-site retrieval system 34 2 outputs 
the retrieval result page SPk. 

According to the sub-access sequence extraction 
rule, from an access to a page having the retrieval 
result page SPi as reference information (that is, an 
access to the Web page Pf2) up to an access to a page 
within the customer site 61 just preceding an access to 
the retrieval result page SPj (that is, an access to 
the Web page Pf2) serves as a sub-access sequence 103. 
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Likewise, SPj -> Pf3 — » Pf4 — > Pf5 from an access 
to the retrieval result page SPj to an access to a page 
within the customer site 61 just preceding an access to 
the retrieval result page SPk (that is, an access to 
5 the Web page Pf5) serves as a sub-access sequence 104. 

Because an access to the retrieval result page SP1 by 
a retrieval system within the customer site 61 
corresponds to an access to a page having the retrieval 
result page SPk by the retrieval system 342 outside the 

10 customer site 61 as reference information, according to 

the sub-access sequence extraction rule, the access to 
the retrieval result page SPl by the retrieval system 
within the customer site 61 acts as a starting end of 
the sub-access sequence 105. 

15 Likewise, SPl — > Sf6 from an access to the 

retrieval result page SPl up to an access to a page 
within the customer site 61 (that is, an access to the 
Web page Pf6) just preceding an access to the retrieval 
result page SPm serves as a sub-access sequence 105. 

20 Likewise, the retrieval result page SPm serves as 

a sub-access sequence 106 and SPn — > Pf7 — > Pf8 serve as 
a sub-access sequence 107. 

The relation between a sub-access sequence 
extracted from an access sequence within the customer 

25 site 61 and the after-retrieval browsing time will be 

described based on the sub-access sequence described 
above . 
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If the retrieval system exists within the customer 
site 61, the after-retrieval browsing time in an access 
sequence within the customer site 61 refers to a time 
interval obtained by subtracting an access time to a 
first keyword related page (that is, a page next to the 
retrieval result page) from a last access time in the 
access sequence (that is, access sequence within the 
customer site 61) . When the retrieval system exists 
outside the customer site 61, it refers to a difference 
in time from an access having reference information 
using the retrieval system to a last browsed access. 
If this is applied to the sub-access sequence, 
following is said. 

FIG. 64 is a diagram showing an example of the 
relation between a sub-access sequence in which an 
access to the retrieval result page acts as a starting 
end and the after-retrieval browsing time where the 
retrieval system within the customer site 61 outputs 
a retrieval result page. In this sub-access sequence, 
the browsing person browses the retrieval result page 
SPo and the Web pages Pgl to Pg3 successively. Such 
a case is processed by the first to fourth embodiments 
and the sixth to eighth embodiments. 

In such a case, a time interval from an access to 
the Web page Pgl, which is a next access to an access 
to the retrieval result page Sp, to an access to the 
Web page Pg3, which is a last access in the sub-access 



108 



sequence, is the after-retrieval browsing time. 
However, if the sub-access sequence is constituted of 
only the retrieval result page SPo, the after-retrieval 
browsing time is set to 0. 

FIG. 65 is a diagram showing an example of the 
relation between a sub-access sequence in which an 
access to a page having a retrieval result page by the 
retrieval system outside the customer site 61 as 
reference information acts as a starting end and the 
after-retrieval browsing time where the retrieval 
system outside the customer site 61 outputs a retrieval 
result page. In the sub-access sequence, the browsing 
person browses the Web pages Phi to Ph4 successively. 
Such a case is processed by the fifth embodiment. 

In such a case, a time interval from an access to 
the Web page Phi, which is a next access of the 
retrieval result page (that is, access having the 
retrieval result page as reference information) , to an 
access to the Web page Ph4, which is a last access in 
the sub-access sequence, acts as the after-retrieval 

browsing time. 

If the starting end of the sub-access sequence is 
an access to the Web page having the retrieval result 
page output by the retrieval system outside the 
customer site 61 as reference information, a browsing 
time from an access at the starting end of the sub- 
access sequence to the terminal end of the sub-access 
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sequence acts as the after-retrieval browsing time. 
However, if the starting end of the sub-access sequence 
is equal to the terminal end of the sub-access 
sequence, the after-retrieval browsing time refers to 
an access time at the starting end of the sub-access 
sequence . 

Although the sub-access sequence extracted by 
using the retrieval system within the customer site 61 
includes a retrieval result page, a sub-access sequence 
extracted by using the retrieval system outside the 
customer site 61 does not include any retrieval result 
page. However, even if the retrieval system is located 
inside or outside the customer site 61, by calculating 
the after-retrieval browsing time based on the relation 
shown in FIGS. 64 and 65, the qualitative evaluation 
value is calculated properly for an access condition in 
the customer site 61. 

Hereinafter the concept of this embodiment will be 
described about a case where it is applied to the first 
embodiment. However, the concept of the present 
embodiment can be applied to the second to eighth 
embodiments also. 

FIG. 66 is a block diagram showing an example of 
the configuration of the retrieval keyword analyzing 
system. 

A retrieval keyword analyzing system 83 reads out 
a retrieval keyword analyzing program 85 recorded in 
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a recording medium 84 and executes it. 

When the retrieval keyword analyzing program 85 
is read by the system 83 and executed, the log pre- 
processing unit 12, a sub-access sequence extracting 
unit 8 6, a keyword extracting unit 87 and an evaluation 
value calculation unit 88 are achieved. 

The evaluation value calculation unit 88 includes 
a satisfaction degree calculation unit 89 and the 
satisfaction degree/keyword relating unit 16. 

Data created by each of the units 12, and 86 to 88 
are stored in the storage device 38. The units 12, and 
86 to 88 are capable of reading data stored in the 
storage device 38. That is, exchange of various kinds 
of data among the units 12, and 86 to 88 may be carried 
out through the storage device 38. In this case, data 
providing side records the provided data in the storage 
device 38 and data receiving side reads out data from 
the storage device 38. 

FIG. 67 is a block diagram showing a specific 
example of the sub-access sequence extracting unit 86. 

The sub-access sequence extracting unit 86 
includes an access sequence extracting unit 90 and 
a sub-access sequence determining unit 91. 

The access sequence extracting unit 90 has the 
same function as the access sequence extracting unit 13 
and a feature of adding information necessary for 
determining the sub-access sequence to the access 
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sequence data which is an output result. 

The access sequence extracting unit 90 extracts 
an access sequence from a series of page accesses 
according to a predetermined access sequence extracting 
rule and creates access sequence data expressing an 
access sequence extraction result. 

For example, as the access sequence extracting 
rule, the rule mentioned in the first embodiment is 
used. 

FIG. 68 shows an example of access sequence data 
created by the access sequence extracting unit 90. 

As shown in FIG. 68, data in which reference 
information is added to the access sequence data shown 
in FIG. 6 turns to access sequence data created by 
the access sequence extracting unit 90. In FIG. 68, 
a case where no reference information exists is 
indicated with - - 

The sub-access sequence determining unit 91 has 
a function of cutting out a sub-access sequence from 
the extracted access sequence. The sub-access sequence 
determining unit 91 extracts a sub-access sequence 
based on the access sequence shown in FIG. 68. 

FIG. 69 is a block diagram showing a specific 
example of the sub-access sequence determining unit 91. 

The sub-access sequence determining unit 91 
includes a sub-access sequence starting end determining 
unit 92 for determining the starting end and a 



sub-access sequence terminal end determining unit 93 
for determining the terminal end. 

The sub-access sequence starting end determining 
unit 92 determines the starting end of the sub-access 
sequence based on the sub-access sequence extracting 
rule and the access sequence data shown in FIG . 68. 

In order to determine that some access is 
an access to the retrieval result page 2 output by 
a retrieval system within the customer site 61, the 
sub-access sequence starting end determining unit 92 
acquires the starting end by using information 94 for 
specifying a retrieval system within the customer site 
61 shown in FIG. 8. 

In order to determine that some access is an 
access to a Web page having a retrieval result page 
output by a retrieval system outside the customer 
site 61 as the reference information, the sub-access 
sequence starting end determining unit 92 acquires 
the starting end by using information 95 for specifying 
a retrieval system outside the customer site 61 as 
shown in FIG. 31. 

The sub-access sequence terminal end determining 
unit 93 determines the terminal end of the sub-access 
sequence based on the above-described sub-access 
sequence extracting rule, starting end data determined 
by the sub-access sequence starting end determining 
unit 92 and access sequence data shown in FIG. 28. 
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The sub-access sequence terminal end determining 
unit 93 provides sub-access sequence data indicating 
an extraction result of the sub-access sequence based 
on the determined starting end and terminal end to the 
5 satisfaction degree calculation unit 88. 

More specifically, a following operation is 
performed. First, the sub-access sequence starting end 
determining unit 92 collects the access sequence data 
shown in FIG. 68 into those each having the same visit 

10 ID and rearranges them in the order of date and time 

from older one. FIG. 70 shows a temporary first table 
generated as a result of the processing. 

Assume that the URL of the customer site 61 
starts from *http; //www. OOO , co . jp/ /' FIG. 71 shows 

15 a screen transition of access sequence visitl in 

FIG. 70 expressed in the same form as FIGS. 58 to 67. 
In the access sequence visitl, accesses are made to 
a retrieval result page output by a retrieval 
system outside the customer site 61 

20 http : //www. □□□ . ne . jp/search . cgi ?kw=vegi table -> Web 

page * AAA. html" within the customer site 61 —» 
*CCC.html" -> ^EEE.html" -> a retrieval result page 

* search . cgi?q = food" output by the retrieval system 
within the customer site 61 -> Web page ^FFF.html" 

25 within the customer site — > ^GGG.html" in this order. 

According to the sub-access sequence extraction rule, 

* AAA. html" -» ^CCC.html" -» * EEE . html" is a first 



sub-access sequence 108 and * search. cgi?q = food" -> 
^FFF.html" -» * GGG . html" is a second sub-access 
sequence 109. How to extract these sub-access 
sequences will be described specifically. 

After the above-described rearrangement is 
performed, which is an access which acts as the 
starting end is determined according to the sub-access 
sequence extracting rule. An access determined to be 
the starting end is supplied with a starting end flag. 
FIG. 72 shows a temporary second table generated as 
a result of the processing. 

As for the starting end flag, * 1" indicates the 
starting end of a sub-access sequence while * 0" 
indicates the other. In-customer site retrieval system 
specifying information 94 and out-of-customer site 
retrieval system specifying information 95 are 
employed. FIG. 8 shows an example of . the in-customer 
site retrieval system specifying information 94 and 
FIG. 73 shows an example of the out-of-customer site 
retrieval system specifying information 95. 

For example, viewl in FIG. 72 has 
http: / /www. □□□ .ne . jp/ search . cgi?kw= vegi table 
coinciding with the *URL of the retrieval system" and 
* query pattern" shown in FIG. 73 as reference 
information. Thus, this turns to a starting end of 
an access to the Web page, namely the sub-access 
sequence within the customer site 61 having a retrieval 
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result page output by the retrieval system outside the 
customer site as reference information and m l" is 
recorded in the starting end flag of viewl in FIG. 72. 
In FIG. 72, view6 has * /search . cgi?q=banana" coinciding 
5 with * location of the retrieval system" * query pattern" 

indicated in FIG. 8 as a request. Thus, this turns to 
an access to a retrieval result page output by the 
retrieval system within the customer site 61, namely, 
the starting end of the sub-access sequence. Then, m 1" 
10 is recorded in the starting end flag of view6 in 

FIG. 72. 

According to the sub-access sequence extracting 
rule, the sub-access sequence terminal end determining 
unit 93 determines an access which acts as the terminal 

15 end from FIG. 72. An access determined to be the 

terminal end is supplied with a terminal end flag. 
FIG. 74 shows a temporary third table generated as 
a result of the processing. 

As for the starting end/terminal end flags, *2" 

20 indicates the terminal end of the sub-access sequence, 

* 1" indicates the starting end of the sub-access 
sequence and * 0" indicates the others. If the starting 
end and the terminal end of the sub-access sequence 
overlap each other, * 3" is set. For example, in 

25 FIG. 72, view5 is an access within the customer site 

just preceding the starting end of a next sub-access 
sequence with respect to the starting end of a 
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sub-access sequence. Thus, this turns to the terminal 
end of the sub-access sequence and *2" is set to the 
starting end/terminal end flag of FIG. 74. Further, 
in FIG. 72, viewl3 has no starting end of a next 
5 sub-access sequence with respect to the starting end of 

the sub-access sequence and is an access at the 
terminal end of an access sequence within the customer 
site 61. Thus, this turns to the terminal end of the 
sub-access sequence and *2" is set to the starting 

10 end/terminal end flag of FIG. 74. 

A sub-access sequence is extracted based on 
the starting end and the terminal end. An interval 
whose starting end starts from * 1" and terminal end 
terminates at * 2" or starting end starts from * 3" 

15 and terminal end terminates at m 3" is supplied with 

no-overlapping access identifier (subVisit ID) 
(hereinafter referred to as sub-access sequence 
identifier) . However, the same access identifier is 
given in the same interval. An interval starting from 

20 *2" and terminating at *1," namely, a case where the 

subVisit ID has no value is expressed with 
Rearrangement is executed with viewID. 

FIG. 75 shows an example of the extracted 
sub-access sequence data. 

25 Here, refer to FIG. 71 again. The sub-access 

sequence 108 in FIG. 71 corresponds to SubVisitl in 
FIG. 75 while the sub-access sequence 109 corresponds 



to SubVisit2 in FIG. 75. In FIG . 75, SubVisitl is 
* AAA. html" *CCC.html'' *EEE.html" while SubVisit2 
is ^search. cgi?q = food" -> * FFF . html" -> *GGG.html." 
This coincides with a screen transition in the 
sub-access sequence 108 and sub-access sequence 109 
in FIG. 71. As a result, it is evident that the 
sub-access sequence determining unit 91 functions well 
as the sub-access sequence extraction rule specifies. 

As shown in FIG. 75, an off-site retrieval system 
flag is set up in sub-access sequence data. 

The off-site retrieval system flag is set to * 1" 
in a sub-access sequence determined based on a 
retrieval result page by a retrieval system outside 
the customer site 61, m 0" in a sub-access sequence 
determined based on a retrieval result page by the 
retrieval system within the customer site 61 and 
in other cases. As described in FIGS. 63 and 65, the 
off-site retrieval system flag is used to switch the 
calculation method of the after-retrieval browsing time 
depending on which the retrieval system is located 
inside or outside the customer site 61. 

The keyword extracting unit 87 decodes an encoded 
retrieval keyword to a readable character string so as 
to generate keyword data. 

Although the keyword extracting unit 87 has the 
following first and second features, the other points 
are the same as the keyword extracting unit 14 
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described in FIG . 2. 

First, the keyword extracting unit 87 also 
extracts a retrieval keyword for a retrieval system 
outside the customer site 61. Extraction of the 
5 retrieval keyword input to the retrieval system outside 

the customer site 61 is carried out in the same method 
as the keyword extracting method described in the fifth 
embodiment . 

Second, if an access to the retrieval result page 

10 2 output by the retrieval system within the customer 

site 61 corresponds to an access to a Web page having 
the retrieval result page 2 output by the retrieval 
system outside the customer site 61 as reference 
information, the keyword extracting unit 87 extracts 

15 a retrieval keyword to an access to the retrieval 

result page 2 output by the retrieval system within the 
customer site 61. 

The output style of keyword data by the keyword 
extracting unit 87 is the same as FIG. 10. 

20 The satisfaction degree calculation unit 89 

calculates an after-retrieval browsing time based on 
sub-access sequence data generated by the sub-access 
sequence extracting unit 8 6 and calculates the 
satisfaction degree of the browsing person. 

25 Although the satisfaction degree calculation unit 

89 has the following first and second features, the 
other points are the same as the satisfaction degree 
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calculation unit 15 described in FIG. 2. 

First, the satisfaction degree calculation unit 89 
acquires the after-retrieval browsing time based on 
the qualitative evaluation rule not for each access 
sequence but for each sub-access sequence so as to 
calculate the satisfaction degree. 

Second, the satisfaction degree calculation unit 
89, as described in FIGS. 63 and 65, switches the 
calculation method of the after-retrieval browsing time 
depending on which the retrieval system is located 
inside or outside the customer site 61 so as to acquire 
the after-retrieval browsing time. Which the sub- 
access sequence depends on retrieval system located 
inside or outside the customer site 61 is determined 
based on an off-site retrieval system flag in FIG. 75. 

FIG. 76 shows an example of extracted satisfaction 
degree data. 

FIG. 76 contains a record which relates each 
access identifier, sub-access sequence identifier 
indicating the sub-access sequence which the access 
belongs to, and the satisfaction degree corresponding 
to the sub-access sequence identifier. As regards 
the item SubVisit ID, a portion having no sub-access 
sequence identifier has no satisfaction degree and 
therefore those portions are expressed with 

The satisfaction degree/keyword relating unit 16 
relates the retrieval keyword to the satisfaction 
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degree of a sub-access sequence corresponding to the 
retrieval keyword based on the keyword data generated 
by the keyword extracting unit 87 and the satisfaction 
degree data shown in FIG. 76 so as to calculate 
relation data of a form shown in FIG. 14. 

FIG. 77 is a flow chart showing an example of the 
operation of the retrieval keyword analyzing system 83. 

In step Zl, the log pre-processing unit 12 inputs 
necessary information from information contained in the 
Web access log 7 to create pre-processed data. 

In step Z2, the sub-access sequence extracting 
unit 86 extracts an access sequence based on the 
pre-processed data and the access sequence extraction 
rule and creates access sequence data. 

In step Z3 , the sub-access sequence extracting 
unit 86 extracts a sub-access sequence based on the 
access sequence data and the sub-access sequence 
extraction rule and creates sub-access sequence data. 

In step Z4, the satisfaction degree calculation 
unit 15 calculates the satisfaction degree of each 
sub-access sequence based on the sub-access sequence 
data and the satisfaction degree calculating rule and 
creates satisfaction degree data. 

In step Z5, the keyword extracting unit 14 
extracts a retrieval keyword input to the retrieval 
system within the customer site 6 and the retrieval 
system outside the customer site 6, based on the 



pre-processed data and creates keyword data. 

In step Z6, the satisfaction degree/keyword 
relating unit 16 calculates the satisfaction degree of 
each retrieval keyword based on the satisfaction degree 
data and keyword data and creates relation data. 

Step Z5 may be executed prior to steps Z2 to Z4 or 
after those steps or in parallel. 

According to this embodiment, even if multiple 
retrieval keywords are input in a series of access 
sequences (if multiple retrieval actions are executed) , 
the qualitative evaluation value of each of the 
multiple retrieval keywords is acquired and further 
the qualitative evaluation value and quantitative 
evaluation value of each retrieval keyword is 
calculated. 

Generally, a site browsing person often uses the 
retrieval system and he may often input the retrieval 
keywords several times in a series of accesses. 
According to this embodiment, in this case also, the 
qualitative evaluation value of each retrieval keyword 
is obtained and the retrieval keyword and the retrieval 
system which executes a retrieval based on the 
retrieval keyword is analyzed sufficiently accurately. 

Although according to this embodiment, a case 
where the satisfaction degree is adopted as an index 
indicating the quantitative evaluation value has been 
described, it is possible to employ other index such as 



the success degree as the qualitative evaluation value. 

Other methods than the one defined in this 
embodiment are applied as the after-retrieval browsing 
time. For example, the after-retrieval browsing time 
may be determined in a relation with the content of the 
Web page. 

Although according to this embodiment, the 
sub-access sequence extracting unit 86 extracts a 
sub-access sequence after an access sequence is 
extracted, the sub-access sequence may be extracted 
directly without extracting the access sequence. 

Each component or unit of the retrieval keyword 
analyzing system of the above embodiments may be 
modified in their arrangement if the same operation is 
achieved and those components and units may be combined 
freely. 

According to the above embodiments, the retrieval 
keyword analyzing system is constituted of multiple 
computers and the retrieval keyword analyzing program 
may be distributed in multiple computers so as to 
execute the processing under communication among those. 

The retrieval keyword analyzing program of each 
embodiment may be written in for example, a magnetic 
disc (flexible disc, hard disc and the like) , an 
optical disc (CD-ROM, DVD and the like) , a 
semiconductor memory and other recording mediums and 
installed in the computer. Further, the retrieval 



keyword analyzing program may be distributed through 
a communication medium and installed in the computer. 
The computer reads the retrieval keyword analyzing 
program recorded in the recording medium and its 
operation is controlled by the retrieval keyword 
analyzing program so as to achieve the above function. 

According to an embodiment of the invention, a 
retrieval keyword analyzing program makes a computer 
achieve an access sequence detecting unit which 
extracts an access sequence indicating continuous 
accesses by the same access person based on a Web 
access log which relates access person identification 
data in WWW with accessed person identification data 
and records the access sequence data indicating an 
extraction result of the access sequence in a recording 
medium; a keyword extracting unit which, when access 
destination identification data indicating a retrieval 
system in WWW is related to a retrieval keyword input 
to the retrieval system by an access person in the Web 
access log, extracts a retrieval and recording keyword 
data indicating an extraction result of the retrieval 
keyword; an evaluation value calculation unit which 
calculates a qualitative evaluation value corresponding 
to the access sequence indicated by access sequence 
data recorded in the recording medium, based on 
a qualitative evaluation rule for defining a standard 
for calculating the qualitative evaluation value 



corresponding to a retrieval result of the retrieval 
system in the WWW and records relation data indicating 
the relation between the retrieval keyword input in the 
access sequence of retrieval keywords indicated by 
keyword data recorded in the recording medium and the 
qualitative evaluation value. 

Therefore, the qualitative evaluation value for 
a retrieval result by the retrieval system based on the 
input retrieval keyword is grasped easily. Both the 
access sequence extracting unit and the keyword 
extracting unit is operated in parallel. 

The evaluation value calculation unit may 
calculate not only the qualitative evaluation value but 
also the quantitative evaluation value corresponding 
to an access sequence indicated by access sequence 
data recorded in the recording medium based on the 
quantitative evaluation rule which defines a standard 
for calculating a quantitative evaluation value on 
a retrieval result of the retrieval system and record 
relation data indicating the relation among a retrieval 
keyword input in an access sequence of retrieval 
keywords indicated by the keyword data recorded in the 
recording medium, the qualitative evaluation value and 
quantitative evaluation value. 

Therefore, the qualitative evaluation value and 
quantitative evaluation value on the retrieval result 
by the retrieval system based on the input retrieval 



keyword and the relation between the qualitative 
evaluation value and the quantitative evaluation value 

is grasped easily. 

According to another embodiment of the invention, 
a retrieval keyword analyzing program makes a computer 
achieve an access sequence extracting unit which 
extracts an access sequence indicating continuous 
accesses by the same access person based on a Web 
access log which relates access person identification 
data in WWW with access destination identification 
data and records access sequence data indicating an 
extraction result of the access sequence in a recording 
medium; a keyword extracting unit which, when a 
retrieval keyword is input in an access sequence 
indicated by access sequence data recorded by the 
recording medium while the access destination 
identification data indicating the retrieval system in 
the WWW is related to a retrieval keyword input to the 
retrieval system by the access person in the Web access 
log, extracts a retrieval keyword and records keyword 
data indicating an extraction result of the retrieval 
keyword in the recording medium; and an evaluation 
value calculation unit which calculates a qualitative 
evaluation value corresponding to an access sequence 
indicated by access sequence data recorded in the 
recording medium based on the qualitative evaluation 
rule which defines a standard for calculating the 
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qualitative evaluation value on the retrieval result by 
the retrieval system when the WWW is accessed and 
records the relation data indicating the relation 
between the retrieval keyword indicated by keyword data 
5 recorded in the recording medium and the qualitative 

evaluation value. 

The access sequence extracting unit and the 
keyword extracting unit are actuated in series. 
The evaluation value calculation unit may 

10 calculate a qualitative evaluation value corresponding 

to an access sequence indicated by an access sequence 
data recorded in the recording medium based on the 
quantitative evaluation rule which defines a standard 
for calculating a quantitative evaluation value on a 

15 retrieval result by the retrieval system as well as the 

qualitative evaluation value and record relation data 
indicating the relation between the retrieval keyword 
indicated by keyword data recorded in the recording 
medium, the qualitative evaluation value and the 

20 quantitative evaluation value. 

It is possible that the Web access log contains 
data which relates reference information with access 
destination identification data, the access sequence 
extracting unit, when the reference information 

25 indicates the retrieval system, extracts an access 

sequence containing an access to the access destination 
indicated by the access destination identification data 



related with the reference information, the keyword 
extracting unit, when the reference information 
indicates the retrieval system, extracts the retrieval 
keyword included in the reference information and the 
evaluation value calculation unit calculates a 
qualitative evaluation value after a retrieval keyword 
is input to the access sequence. 

Therefore, using the reference information enables 
a retrieval keyword input to the retrieval system out 
of site to be analyzed even from a Web access log 
recorded at an access destination. 

According to still another embodiment of the 
invention, there is provided a retrieval keyword 
analyzing program which makes a computer achieve a sub- 
access sequence extracting unit which, when reference 
information indicates a retrieval system for WWW based 
on a Web access log which relates access person 
identification data in the WWW, access destination 
identification data and the reference information, 
extracts an access sequence containing an access to 
an access destination indicated by access destination 
identification data related with the reference 
information and indicating continuous accesses by the 
same access person; a keyword extracting unit which, 
when the reference information indicates a retrieval 
system, extracts a retrieval keyword contained in the 
reference information and records keyword data 
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indicating an extraction result of the retrieval 
keyword in the recording medium; an evaluation value 
calculation unit which calculates a qualitative 
evaluation value after a retrieval keyword is input 
to an access sequence indicated by access sequence 
data recorded in the recording medium based on the 
qualitative evaluation rule which defines a standard 
for calculating the qualitative evaluation value on a 
retrieval result by the retrieval system when the WWW 
is accessed, and records relation data indicating the 
relation between a retrieval keyword corresponding to 
the access sequence of retrieval keywords recorded in 
the recording medium and a qualitative evaluation value 
corresponding to the access sequence in the recording 
medium. 

The evaluation value calculation unit may 
.calculate not only the qualitative evaluation value 
but also the quantitative evaluation value after a 
retrieval keyword corresponding to an access sequence 
indicated by the access sequence data recorded in the 
recording medium based on the qualitative evaluation 
rule which defines a standard for calculating the 
qualitative evaluation value recorded in the recording 
medium and record relation data indicating the relation 
between the retrieval keyword indicated by keyword data 
recorded in the recording medium and the quantitative 
evaluation value. 



When relation data indicating the relation among 
the retrieval keyword, the qualitative evaluation value 
and quantitative evaluation value is obtained, it is 
possible to add a program which makes a computer 
achieves a graphing unit for drawing a graph based on 
the qualitative evaluation value and the quantitative 
evaluation value. Therefore, the analysis result is 

grasped more easily. 

The qualitative evaluation value may be a need 
value of a retrieval result whose value increases as 
the number of inputs of the retrieval keyword increases 
and the quantitative evaluation rule may be a rule 
under which the need value increases as the number of 
inputs of the retrieval keywords increases. 

The qualitative evaluation rule may be a rule 
which increases the success degree to an access 
sequence when an analysis object retrieval keyword is 
input to the access sequence based on data which 
relates an analysis object retrieval keyword with 
access destination identification data which increases 
the success degree when an access is made after the 
retrieval keyword is input and keyword data recorded in 
the recording medium and the access destination 
indicated by the access destination identification data 
related with the analysis object retrieval keyword is 
accessed after the input and the qualitative evaluation 
value may be the success degree. 
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In this case, the qualitative evaluation rule may 
increase the success degree as the number of accesses 
until an access destination indicated by access 
destination identification data related with the 
analysis object retrieval keyword after the analysis 
object retrieval keyword is input decreases. 

The Web access log relates access person 
identification data, access destination identification 
data and data indicating access time each time when the 
WWW is accessed and the qualitative evaluation rule is 
a rule which increases the satisfaction degree of an 
access person as time interval from an access after 
a retrieval keyword is input to the access sequence to 
a last access increases and the qualitative evaluation 
value may be the satisfaction degree. 

According to still another embodiment of the 
invention, a retrieval keyword analyzing program makes 
a computer achieve a sub-access sequence extracting 
unit which extracts a sub-access sequence based on 
a starting end determined by an access to a retrieval 
result page of continuous accesses made by the same 
access person and a terminal end determined by an 
access subsequent to the starting end of continuous 
accesses made by the same access person as for the 
starting end, according to a Web access log which 
relates access person identification data in the WWW 
with access destination identification data indicating 



an access destination made by the access person and 
records sub-access sequence data indicating an 
extraction result of the sub-access sequence in the 
recording medium; a keyword extracting unit which, when 
access destination identification data indicating a 
retrieval system in the WWW is related with retrieval 
keyword input to the retrieval system by the access 
person in the Web access log, extracts a retrieval 
keyword and records keyword data indicating an 
extraction result of the retrieval keyword in the 
recording medium; and an evaluation value calculation 
unit which calculates a qualitative evaluation value 
corresponding to sub-access sequence indicating sub- 
access sequence data recorded in the recording medium 
based on the qualitative evaluation rule which defines 
a standard for calculating qualitative evaluation value 
on a retrieval result of the retrieval system when the 
WWW is accessed and records relation data indicating 
the relation between a retrieval keyword corresponding 
to the sub-access sequence of the retrieval keywords 
indicated by keyword data recorded in the recording 
medium and the qualitative evaluation value in the 
recording medium. 

According to still another embodiment of the 
invention, a retrieval keyword analyzing program makes 
a computer achieve a sub-access sequence extracting 
unit which extracts a sub-access sequence by acquiring 
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a starting end determined by an access to a retrieval 
result page and a next starting end and then acquiring 
a terminal end corresponding to the starting end based 
on an access just before the next starting end 
according to a Web access log which relates access 
person identification data in the WWW with access 
destination identification data indicating an access 
destination made by the access person and records sub- 
access sequence data indicating an extraction result of 
the sub-access sequence in the recording medium; a 
keyword extracting unit which, when access destination 
identification data indicating a retrieval system in 
the WWW is related with retrieval keyword input to the 
retrieval system by the access person in the Web access 
log, extracts a retrieval keyword and records keyword 
data indicating an extraction result of the retrieval 
keyword in the recording medium; and an evaluation 
value calculation unit which calculates a qualitative 
evaluation value corresponding to sub-access sequence 
indicating sub-access sequence data recorded in the 
recording medium based on the qualitative evaluation 
rule which defines a standard for calculating 
qualitative evaluation value on a retrieval result of 
the retrieval system when the WWW is accessed and 
records relation data indicating the relation between 
a retrieval keyword corresponding to the sub-access 
sequence of the retrieval keywords indicated by keyword 



data recorded in the recording medium and the 
qualitative evaluation value in the recording medium. 

According to still another embodiment of the 
invention, a retrieval keyword analyzing program makes 
a computer achieve a sub-access sequence extracting 
unit which extracts a sub-access sequence based on a 
starting end and a terminal end by, when the starting 
end determined by an access to a retrieval result page 
of continuous accesses made by the same access person 
and a next starting end are acquired, regarding an 
access just before the next starting end as the 
terminal end and when the starting end is acquired but 
no next starting end is acquired, regards the terminal 
end of continuous accesses as a terminal end 
corresponding to the starting end, according to a Web 
access log which relates access person identification 
data in. .the WWW with access destination identification 
data indicating an access destination made by the 
access person, and records sub-access sequence data 
indicating an extraction result of the sub-access 
sequence in the recording medium; a keyword extracting 
unit which, when access destination identification data 
indicating a retrieval system in the WWW is related 
with retrieval keyword input to the retrieval system by 
the access person in the Web access log, extracts a 
retrieval keyword and records keyword data indicating 
an extraction result of the retrieval keyword in the 
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medium. 

Therefore, changes in the qualitative evaluation 
value and quantitative evaluation value of the 
retrieval keyword to be input to the retrieval system 
in order to access a portion of analyzing object in the 
WWW is acquired in time series. 

When relation data indicating the relation among 
the retrieval keyword, the qualitative evaluation value 
and quantitative evaluation value is acquired, the Web 
access log is data which relates the access person 
identification data, access destination identification 
data and time data indicating an access time and the 
evaluation value calculation unit obtains the relation 
data of each of the multiple time periods based on the 
time data and makes the computer achieve the category 
forming unit for calculating the qualitative evaluation 
value and quantitative evaluation value on the category 
for each of the multiple time periods based on the 
category data which relates the retrieval keyword with 
a category which that retrieval keyword belongs to and 
the relation data of each of the multiple time periods 
and records in the recording medium and the trend 
analyzing unit for obtaining trend data indicating 
a transition condition of the qualitative evaluation 
value and quantitative evaluation value of the category 
and recording in the recording medium. 

Therefore, the retrieval keywords is related so as 



to analyze the category which an analyzer wants. 

The above-mentioned retrieval keyword analyzing 
program is capable of adding these functions to 
computer, computer system, server and client not having 
the respective functions easily by using a recording 
medium in which a program is recorded. 

By providing the retrieval keyword analyzing 
system with means for achieving the same operation as 
the function achieved by the invention, the same 
operation and effect is acquired. 

By applying the above-mentioned retrieval keyword 
analyzing program or a recording medium in which the 
program is recorded to a computer, the retrieval 
keyword analyzing method for grasping the quantitative 
evaluation value on a retrieval result of the retrieval 
system based on the input retrieval keyword easily is 
executed on the computer. 



